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INTRODUCTION 




The L eader's Guide for Student Engaged Time Is Intended to be used 
by program participants who are leading or conducting meetings In which 
participants apply the Instructional Improvement cycle to the variable 
of student engaged time. It includea suggestions for activities past 
participants found helpful In teaching thla Information to prospective 
participants at the regional, district, and school levels. It may also 
be helpful to refer to these suggestions during later rounds of the 
Instructional improvement cycle* Details and auggeatlons about the 
specific role of each level (e.g#, regional, district, principal) In 
relationship to activities associated with this variable may be found 
In the appropriate section of the Leader's Guldea for each level. 

Information about the general organization of thla guide Is Included 
in the Leader's Guide for Orientation * The following pages provide 
introductory information about the Leader f 6 Guide for Student Engaged 
Time including specific Information about the contents of thla guide, an 
overview of the suggested activities for student engaged time, and 
glossaries of the terms used in each section of the guide* 

The introduction is followed by four sections wbich give detailed 
suggestions for the topics and activities associated with applying the 
instructional improvement cycle to student engaged time. 

Section I— Information Collection 
Section 2 — Comparison and Identification 
Section 3™ Selection and Preparation 
Section 4 — Implementation and Recycling 



Each of these four sections is organized , as described in the Leader's 
Guide for Orientation, and includes general information: 



Preview — a brief overview of the section 

PuT£ose~major goal of the activities in the section 

Objectives— specif ic objectives to be accomplished 

Expected Outcomes— probable outcomes of the suggested 
activities 

Time — estimated amount of time needed to complete 
activities 
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Materials — lists of handouts, transparencies, and videotapes 
used in the section 

Follow-up — activities that participants have found necessary 
or useful in achieving the objectives or in prepnrlng for 
the next section 

Agenda — listing and brief description of topics 
Specific information for each topic is also included: 

Topic Outline — main topics to be covered 

Rationale— reason for including the topic and estimate of 
time needed to cover it 

Strategies — suggestions for presenting the topic 

Materials — list of pertinent handouts, transparencies, and 
video tapes 

Alternative Strategies — suggestions for ways to adapt to 
particular situations 

The rationale, materials, strategy, and alternative 
strategy descriptions are enclosed 1 ithin a frame. 
Following that frame, the topic outline continues, 
presenting the major points to be discussed and 
indicating relevant materials. 

Mate rials — master copies. of the handouts and transparencies and 
descriptions of the videotape segments used 

Note s—background information for the leader coded to correspond 
to the topic outline and indicated there by a dagger (t) 

Appendices containing supplementary or alternative activities or information 
are included at the end of each of the four sections of this guide and are 
keyed to the major topics of that section. Not all topics have appendices, 
so the appendix letters will ^ot necessarily form a complete alphabetic 
series (e.g., Section 1 has appendices A-E and G) . 

Points to Keep, in Mind in Using This Guide 

Preview 



Since the length of meetings may vary from one place to another, the 
approximate amount of time needed for each major topic in the section is 
noted; in general, a break between meetings may correspond to the break 
between any two major topics. 
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In the topic outline, activities or topics which are central to the 
program for all participants and should not be omitted are marked with a 
star ( * ) in the margin. Those activities which must be completed only 
by observers are marked with a circle stsr (@ ). Activities which should 
be completed in training leaders (in addition to <fc and ® activities) 
are marked with a circled L ( (^). 



Materials 



All materials are coded in numerical sequence in the order presented 
in the topic outline. This sequence begins again with "1" for each section. 
Handouts are identified with an "H" in the middle of the identification 
code at the top of the page. Transparencies are identified with a "T." 
Transparencies may be used as handouta if desired. Videotapes are identi- 
fied with a "V." The first numeral in the code indicates the section; the 
last numeral indicates the sequence in which materials are used. Thus 3H4 
is a handout used in the third section of the guide as the fourth audio- 
visual aid. Letters (e.g., a-c) indicate the number of pages in a handout 
or transparency or the number of clips in a videotape. At the beginning of 
each section is a complete list of all the materials used. 

Materials In the appendices are coded by a letter indicating the 
appendix, a letter indicating the type of material (H, T, or V), and a 
numeral indicating the sequence. For example, BT4 is a transparency in 
Appendix B and is used fourth. The section for materials in the appendices 
can be identified by the page number (e.g., page 1.250 is In Section 1). 

Key pages are forms that, when completed, include information that 
teachers should keep for future reference. These pages are indicated by a 
key man (shown at right) in the upper right corner. Leaders may wish to 
print these pages in a special color to stress their importance. 

Checkpoints ( /) used to demonstrate mastery of concepts and skills are 
listed as handouts in the preview, and a list of the answer keys for those 
checkpoints is included. Participants have found the checkpoints to be 
helpful in getting ready for the activities which follow; the checkpoints 
are to be used as a "self-check" by each person. Since individuals will 
probably master each skill or concept at different rates, leaders may want 
to plan for accommodating the** individual differences (perhaps by working 
with small groups or by having someone who has demonstrated mastery help 
someone who has not). 




Answer keys for the checkpoints should be removed from the guide when a 
new leader is being trained and replaced only after the leader has completed 
the checkpoint. 

Multiple copies of some observation instruments will be needed in 
completing activities for Information Collection (Section 1). Masters for 
those forms to be reproduced in quantity are included at the end of that 
section. 
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The videotape s are extremely Important In Section I for student 
engaged tlme t since they are uaed not only to train classroom observers 
but also to ensure the reliability and validity of the collected Information. 
Two 60-minute and one 30-minute 3/4-inch (U-matic) or l/2-inch (VHS format) 
cansette tan*?*; arc n*oulred and another 60-minute tape may bo used; the^r 
may be borrowed f roin Research for fie tte r S chools » Inc . A 3/ 4— inch or 
1/2-inch videotape cassette machine (preferably with a "still-frame" 
feature) Is needed to use the tapes. If you wish to have your own copy 
of the tapes. Research for Better Schools, Inc. will provide a 3/4-inch 
or l/2-lnch cassette of the tapes at no cost If a blank cassette tape 
is sent to them* Duplicates can also be made for 1 /2-inch reel-to-reel 
equipment. If you have access to another kind of machine, you will need 
to make arrangements to copy tapes from someone with 3/4-inch or 1/2-inch 
equipment. 

O v e rview of Student Engaged Time Activities 

Participants have found that meetings over a period of slightly l*>ss 
than one semester (14-16 weeks) are needed in which to learn about and 
carry out the first cycle of the activities associated with applying the 
instructional improvement cycle to student engaged time at the school 
level. During this semester, the program participants attend approximately 
five three-hour meetings or workshops at intervals of one to five weekp. 
After this initial learning cycle, less time will be needed to complete 
each round of activities. 

The Suggested School Activity Chart for Time (page vi) presents one 
possible model time schedule for the process. The first three three-hour 
meetings are spent in completing the activities for Section 1, "Information 
Collection. 11 Two major events are completed: explaining the time variable 
in general terms and learning information collection procedures. A flexible 
time period of about four weeks then follows in which the third major event 
is completed— classroom observations are done. A three-hour meeting is held 
in Week No. 8 in which the activities for Section 2 f "Comparison and Identi- 
fication, 11 and a fourth major event are completed. The next meeting, held 
the following week, is used to complete the activities for Section 3, 
"Selection and Preparation , n and to plan for implementation and monitoring, 
thus completing two more major events. The selected strategies are 
implemented and monitored over the next two weeks which completes major 
event #7. The eighth major event is completed during the last meeting of 
the semester where activities in Section 4, "implementation and Recycling" 
take place. The last four weeks of the semester are used to begin another 
cycle by collecting information again which completes major event #9. 
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The Su ggested S chool Activity Chart presents only one alternative Tor 
scheduling student engage? time activities* It Is possible to organize 
the meetings In many other ways— as full-day workshops, as one- or two-hour 
meetings, or as meetings of varying lengths* Participants have found the 
g chedule for_j?chool Activities for Time (page vlll) t as well as the timet* 
shown In the preview part of each section, of help In structuring and 
scheduling meetings* 

Major activities are shown at the beginning of each section* The 
final goal or task of each section Is shown at the top of the page, with 
prerequisite activities and/or topics described below It* Participants 
have found these diagrams helpful In presenting an overview of each phase 
for planning purposes or as an advance organizer In meetings (Instead of 
or In addition to the agenda)* 
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SIKStSKSTKl) SCHOOL ACTIVITY CHART FOR TIME £ 



■ WKEK NO. 

ACTIVITY " ■ 

INFORMATION COLLECTION 

Introduction 
Instruments and 

procedures 
Observer training (optional) 

Collecting Information 


t 

El 
• 


2 
• 


3 1 

E2 
• 


4 


5 


6 


7 

_ 


8 

E3 


9 


10 


11 



12 



L3 


14 


15 


16 


COMPARISON AND IDENTIFICATION 

Comparing 
Identifying 
Making decisions 





■ 












E4 
• 












_ 






- 

SELECTION AND PREPARATION 

Classroom description 
Strategy selection 
Implementation plan 
Monitoring plan 


■ 
















E5 
E6 
• 
















IMPLEMENTATION 


































RCCYCLINR 

Collecting Information 
























E8 








E9 


Comparing 

Planning for reassessment 
























• 











Kev 
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E Completed major event as shown on next page. 

• Meeting (3 hours) — Preceded by 3-hour planning 
session and 1-day technical training session 
for leaders. 



Flexible time periods required 
by nature of the task — observation 
time required is at least 15 minutes 
for each classroom for each subject 
area for each dav of observation. 
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MAJOR EVENTS FOR TIKE 
The following list Indicates major casks Co be cmpleCed In each school 

El. ScudenC engaged clrae Is explained In general Cerms* 

E2* Information collecClon procedures are learned— observers are 
drained, If necessary* 

E3< InformaClon Is collecCed. 

E4. Classroom InformaClon Is compared Co reference graphs and 

opporCunlCles for improvement are IdenClfled; decisions about Che 
Identified opporCunlCles are made. 

E5. SCraCegy Is selecCed. 

E6. ImplemenCaClon and monlCorlng plans are made, If needed. 
E7, SCraCegy Is ImplemenCed and monlCored. 

E8, ImplemenCaCion Is discussed, and plans are made for recycling, 
E9. InformaClon is again collecCed on sCudenC engaged clme* 
ConClnue repeaClng E4 - E9. 



vil 
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SCHEDULE OF SCHOOL ACTIVITIES FOR TIME 



TIME NEEDED 



INFORMATION COLLECTION 

El. The variable is explained 
in general terms. 

E2. Information collection 
procedures are learned. 
Classroom observers are 
trained and demonstrate 
mastery. 

E3. Information is collected. 



Vl hr. 

3-4 hrs. 
2-5 hrd. 

15 mins* for each 
classroom for each 
subject area for 
each day 



COMPARI S ON AND IDENTIFICATION 

E4. Classroom information is 

compared to reference graphs, 
and opportunities for improve- 
ment are identified; decisions 
about the direction and amount 
of changa are made. 2-3 hrs# 

SELECTION AND PREPARATION 

E5. Strategy is selected. 2 hrs * 

E6. Implementation and monitoring 

plans are made, if needed, 1-1*5 hrs. 

IMPLEMENTATION 

E7 , Strategy is implemented and 

monitored. — 

E8, Implementation is discussed, 

and plans are made for recycling. 1-1*$ hrs# 



RECYCLING 

E9, Information is again 
collected on student 
engaged time. 



15 mins. for each 
classroom for each 
subject area for 
each day 



FORMAT 



DATE(S) 




Meeting 

Meeting 
Meeting 



Independent 



Meeting 

Meeting 
Meeting 

Independent 
Meeting 




Independent 



viii 




9 

ERLC 



14 



7/16/80 




SECTION 1™ INFORMATION COLLECTION 



PREVIEW 



Purpose : 

To Introduce procedures for information collection on time, to train 
classroom observers » and to collect information on allocated time and 
engagement rate in classrooms. 

Objectives : 

To provide an overview of the instructional improvement cycle as it 
pertains to time. 

To provide a rationale for focusing on time, particularly student 
engaged time; to provide definitions for terms: school year, attendance 
year, school day, allocated time, engagement rate, student engaged time, 
and academic learning time; and to provide background on process-product 
research findings on time. 

To teach participants to collect information on allocated time. 




To teach participants to distinguish engaged from unengaged behaviors 
and to collect information on engagement rates. 



To ascertain participants' mastery of the Allocated Time Log and 
Engagement Rate Fo rm. 

To schedule classroom observations. 

To complete data collection on student engaged time in ea2h classroom. 
Expected Outcomes : 

Demonstration of mastery of Allocated Time Log by all participants; 
demonstration of mastery of Engagement Rate Form by observers; schedule 
for initial classroom observations; collected classroom information on 
allocated time and engagement rate. 
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Time: 



AK-mt 5%-9 hours of meeting time Is suggested to complete an in-depth 
presentation, Including the training of observers and demonstration of 
mastery on the Engagement Rate Form. Classroom observations should be 
made after completing Topic H (Scheduling). This time Is allocated by 
topics as follows: 



A. Agenda (5 minutes) 

B. Phases of Instructional Improvement cycle (3 minutes) 

C. Rationale for focus on time (15-25 minutes) 

D. Engagement Rate Form (100-110 minutes) 

E. Observer training on the Engagement Rate Form (60-180 minutes) 

F. Demonstration of mastery of the Engagement Rate Form 
(60-120 minutes) 

G. Allocated Time Log (55-60 minutes) 

H. Scheduling (40 minutes) 



The time needed to complete the minimal activities for nonobservers (k) 
is about 2%-3ij hours. Minimal activities for observers ( ® ) take about 
4^-8^ hours, and minimal activities for leaders take about 5-9 hours. 

Supplementary activities for some topics are Included In the appendices. 
Approximate times for these are: 



B. Phases of the Instructional improvement cycle (30 minutes) 

C. Rationale for focus on time (60 minutes) 

D. Engagement Rate Form (10-15 minutes) 

E. Observer training on the Engagement Rate Form (30-120 minutes) 
C. Allocated Time Log (15-20 minutes) 



Materials : 
Agenda 

Major Activities Chart 

Handouts: BH10, CH12-CH15, 1H17, 1H19, 1H21-1H23, 1H25, DH27, 1H29, 
1H31, 1H35, 1H38, 1H40, /1H42, 1H44-1H46 

Transparencies: 1T1, BT2-BT4, BT6-BT9, CT11, 1T16, 1T18, 1T20, DT28, 
1T30, 1T34, 1T39, 1T41, 1T47 

Answer Keys for Checkpoints: 1T37, 1T43 
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Videotapes: D. Engagement Rate Form — BV5, 1V24, 1V26 

E. Observer Training-- 1V32 , 1V33 

F. Mastery— 1V36 

Engagement Rate Forms (10-17 per participant) 
Allocated Time Logs (4-5 per participant) 
Calculators 

Overhead projector and screen 

3/4' 1 (U-matic) or 1/2' 1 (VHS format) videotape cassette machine and 
television (preferably with 11 still- frame" feature) 

Follow-up : * 

Complete information collection in classrooms. 

Make arrangements for the Comparison and Identification meeting. Before 
this meeting, participants may wish to review standardized achievement 
test results, noting areas in which performance is relatively low. 
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INFORMATION COLLECTION FOR STUDENT ENGAGED TIME 



AGENDA 

A, REVIEW OF AGENDA 

B, INSTRUCTIONAL IMPROVEMENT CYCLE 

t Phases Introduced as they relate to student engaged time 

C, RATIONALE FOR FOCUS ON TIME 

t Definitions of important terms used in research literature 

t Selected findings from studies on time 

t School, district, regional, and state influences on time 

D, ENGAGEMENT RATE FORM 

t Definitions of engaged and unengaged time 

t Practice in identifying engaged and unengaged students 

E, OBSERVER TRAINING 

t Guided practice in completing Engagement Rate Forms for videotaped 
classrooms 

t Independent practice in completing an Engagement Rate Form for a 
videotaped classroom 

F, DEMONSTRATION OF MASTERY 

t Demonstration of mastery of Engagement Rate Form 

G, ALLOCATED TIME LOG 

t Overview and example of Allocated Time Log 
t Practice in completing Allocated Time Logs 
t Demonstration of mastery of Allocated Time Log 

. SCHEDULING CLASSROOM OBSERVATIONS 

Classroom observations should be completed before the next meeting. 
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MAJOR ACTIVITIES FOR INFORMATION COLLECTION FOR TIME 



l" 1 

OUTCOMES: , Participants complete t 

' classroom observations. ' 

I i 





i 


Participants complete an 
Allocated Time Log and cal- 
culate average allocated time, 




Participants classify student 
behaviors as engaged or unen- 
gaged, complete an Engagement 
Rate Form, and calculate en- 
gagement rate to a specified 
criterion, from the videotape 
of a classroom. 


from a given classroom 
schedule. 







t " 

Participants match each of the 
terms (allocated time, engage- 
ment rate, student engaged time) 
to given definitions . Partici- 
pants calculate the value of any 
of the above terms, given data. 




Student Engaged Time = Allocated Time x Engagement Rate 
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Glossary for Information Collection 



Academic Learning Time 



Allocated Time 



Allocated Time Log 



Attendance Year 



Checkpoint 



Discipline 



Engaged 

Engaged Categories 
Engagement Rate 



Amount of time a student spends 
attending to academic tasks while 
performing with a high rate of success. 

Time teachers set aside for Instruc- 
tion In a subject area. 

Instrument used to record Information 
about allocated time. 

Number of days In year a student actually 
attends school. 

Activities which participants use to 
demonstrate mastery of specific concepts 
or skills. 

One of the unengaged categories on the 
Engagement Rate Form. This may be used 
when an adult Is reprimanding a student, 
when a student Is being punished, or when 
a student Is watching another student 
being punished. 

Doing academic work In math or reading/ 
language arts. 

Math or reading/ language arts categories 
used to code students doing academic 
work on the Engagement Rate Form. 

Percent of allocated time that a class 
Is perceived to be actively working, 
or engaged in* learning or percent of 
students engaged in InsLrucUcm aL ;n»y 
given moment of a class. 



Engagement Rate Form 



Managem ent/Translt ion 



Observation instrument used to 
record information about the engaged 
and unengaged behaviors of students* 

One of the unengaged categories on 
the Engagement Rate Form. This is 
used when students are involved in 
daily, routine classroom activities 
or preparatory or "inbetween" 
activities. 
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Other Assigned 

Out of Room 

Part of Period 

Pre-Observation Form 
Process-Product Research 

Pullout Assigned 

School Day 
School Year 

Socializing 

Student Engaged Time 



Category used to code student 
behaviors on the Engagement Rate 
Form. This is used when students 
are assigned to subjects other than 
math or reading/language arts. 

Unengaged category on Engagement Rate 
Form used when students are 
temporarily out of the room. 

Beginning, middle, or end. This 
information is recorded on the 
Engagement Rate Form. 

Instrument used to describe classroom 
activities for the observer. 

Research investigating the relation- 
ships between teacher and student 
behaviors (processes) and student 
achievement (products) . 

Category used to code student 
behaviors on the Engagement Rate 
Form. Pullouts occur when students 
are regularly assigned out of the 
classroom. 

Number of hours per day students are 
in school. 

Number of days scheduled for student 
attendance in a year. 

Unengaged category on Engagement Rate 
Form used when two or more persons 
are interacting socially. 

Amount of time a student is actively 
engaged in attending to academic 
instruction or tasks. Student engaged 
time is equal to allocated time 
multiplied by engagement rate. 
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Time Homograph 
Unengaged 

Unengaged Categories 
Unoccupied/Observing 



Computational tool used to calculate 
student engaged time* 

Not doing or attending to assigned 
academic work* 

Categories used to code unengaged 
student behaviors as relating to 
management/ transition, discipline, 
socializing! unoccupied/observing, 
or out of room on Engagement Rate 
Form. 

Unengaged category used to code 
student behavior on Engagement Rate 
Form* This category Is used when a 
student Is sitting or standing alone, 
wandering about with no evident 
purpose or goal, watching other 
people or unasslgned activities % or 
playing with materials* 
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Time Jlatcr lata for Informa tio n Collec tion 

The fo\ lowing materials art 1 unvd In Information collection fnr Htiitlt-Jil; 
engaged time. Three videnLapet* are used; one (Topic D) contains, B1V5 , 
1V24, and 1V26; another (Topic E) includeo 1V32 and 1V33; while the third 
(Topic F) includes 1V36. 



Topic B — Phases of the instructional improvement cycle 

'A'lTl Instructional Improvement Cycle 
Appendix B 

3T2 Blank Allocated Time Log 

3X3 Completed Allocated Time Log 

BT4 Blank Engagement Rate Form 
(a-b) 

BV5 Classroom Scan for Engagement Rate Form 

]>T6 Completed Engagement Rate form 
(a-b) 

BT7 Completed Time Homograph 

BT8 Third Grade Reading and Language Total Graph 

BT9 Types of Graphs 

BIUO Selected program Modifications 
(a-b) 





Topic C — Rationale for focus on time 

©1T16 Flow Chart for Computing Student Engaged Time 

*1H17 Time Definitions Worksheet 

iiTlfl Answer Key for 1 H 1 7 

©IflP) Ktihli'iit iiuyjtyytl Tlmv Worfcfiliri'f 

© 1T20 Answer Key for 1H19 

*1H21 Time Glossary; Selected References 
(a-b) 



it "Minimal activity for all participants 



(P --Minimal activity* for leaders only 
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Append ix C 

CT11 Measures of Time 
CI112 Estimate Your Time 

CH13 Time Nomograph 

CII14 Engagement Rate and Productive Time (Worksheet) 
CH15 Calculating Student Engaged Time (Worksheet) 

Topic D— -Engagement Rate Form 

^1H22 Definitions of Categories for Engagement Rate Form 
(a-b) 

^rlH23 Descriptions of Engaged Behaviors 

*1V24 Examples of Engaged Behaviors 
(a-c) 

^rlH25 Descriptions of Unengaged Behaviors 

^rlV26 Examples of Unengaged Behaviors 
(a-c) 

^rlH29 Classroom Pictures 
(a-h) 

*1T30 Answer Key for Classroom Pictures 
(a-g) 

Appendix D 

DH27 Chart of Engaged and Unengaged Behaviors (Worksheet) 
DT28 Answer Key for Chart 

Topic E-- -Observer training on the Engagement Rate Form 

1H31 Blank Classroom Diagrams 
(a-q) 

(8HV32 Discrimination of Engaged r*>d Unengaged Behaviors 
(a-c) 

®1V33 Independent Practice in Observation 

®1T34 Answer Keys for 1V32 and 1V33 
(a-h) 

it — Minimal activity for all participants 

® — Minimal activity for observers and leaders 
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Appendix E 

EH31 Blank Classroom Diagrams 
(a-o) 

EV32 Supplementary Tape 
(d-i) 

ET34 Answer Keys for EV32 
(a-1) 

Topic F — Demonstration of Mastery of the Engagement Rate Form 

^5>^1H35 Engagement Rate Form 
(a-g) 

<S> 1V36 Demonstration of Mastery on the Engagement Rate Form 
(a-c) 

© 1T37 Answer Key for /1H35 
(a-f) 

Topic C — Allocated Time Log 

* 1H38 Sue Lee's Classroom (whole class assignments) 
(a-b) 

* 1T39 Answer Key for 1H38 

1HA0 Lisa Hadley's Classroom (parts of class assigned to different 
(a- b) subjects) 

* 1T41 Answer Key for 1H40 

*/Ui42 Allocated Time Log 
(a-b) 

* 1T43 Key for /1H42 
(a-d) 

Appendix C 

/GH42c Erica Swenson's Classroom (whole class assignments) 

GT43 Key for /lH42c 
(e-f) 



25 1.11 



7/17/80 




Topic U — Scheduling 

if 1H44 Alternative Initial Observation Procedures 

* 1H45 Observation Schedule 
<a-b) 

* 1H46 Pre-Observation Form 
(a-b) 

* 1T47 Forms Used in Information Collection 

* — Minimal activity for all participants 

© — Minimal activity for observers and leaders 



Also included are the following forms for use in training and in collecting 
data in classrooms: 




Pre-Observation Form 
Allocated Time Log 
Engagement Rate Form 



Alternate Engagement Rate Form 
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Time Notes for Information Collection 



Topic C 

C* 3-* d « 



Topic D 

D.l.b. 



D. 1. c. 

D.6.a.(l).(h). 



D. 7. 

Topic E 

E. l. 
E-2. 

Topic F 

F. 6. 

Topic G 

G*l.c. 

G. 2o 
G.3. 



Student Engaged Time — Follow Through Classroom 
Observation Evaluation 



The Validity of Using Teachers as Instructional 
Time Data Collectors 

Student Engaged Time: A Comparison of Data 
Collection procedures 

Explanation of Number of Students Present Row on 
the Engagement Rate Form 
Engagement Rate Form 



Videotape of Three Classrooms 
Independent Practice Videotape 



Demonstration of Mastery on the Engagement Rate 
Form 



Allocated Time Log 

Example of Sue Lee*s Classroom 

Example of Lisa Hadley T s Classroom 
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Topic Outline 

^A. Agenda (5 minutes) 



Rationale. There is a need 


to organize the meeting activities. 


i Materials 


Strategy 


—Agenda 


Briefly discuss information listed 


i — Major Activities Chart 


on the agenda and entertain any 




questions or concerns. 



1. Purpose of meeting—introduce procedures for information 
collection on time and train classroom observers 

2. Proposed agenda 

3. Expected outcomes 

a. Participants trained to collect information on allocated 
time and engagement rates 

b. Schedule for initial classroom observations established 




# 
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Ht3, Phases of the instructional improvement cycle (3 minutes) 



Rationale . The participants must understand the relationship between 
Information Collection and other phases of the instructional improve- 
ment cycle. Participants will be able to organize the details of 
this phase if they know how it relates to the rest of the improvement 
cycle. 

Materials Strategy 

lTl"Instructional Discuss the phases of the instructional 

Improvement Cycle improvement cycle. 

Alternative Strategy 

If you wish to provide more details about activities involved in 
applying the instructional improvement cycle, you may want to use 
some of the activities in Appendix B. 



1, Phases of the instructional improvement cycle (3 minutes) (1T1) 

a. Collect information 

b. Compare collected information with research and identify 
desired changes 

c. Select program modification(s) and prepare implementation 
plan 

d. Implement and monitor modifications 

e. Repeat cycle again 
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ERIC 



Materials 

The following supplementary materials are in Appendix Bi 

BT2 Blank Allocated Time Log 

BT3 Completed Allocated Time Log 

BT4 Blank Engagement Rate Form 
<a-b) 



BV5 



BT8 



Classroom Scan for Engagement Rate Form 



BT6 Completed Engagement Rate Form 
<a-b) 

BT7 Completed Time Nomograph 



Third Grade Reading and Language Total Graph 



BT9 Types of Graphs 

BH10 Selected Program Modifications 
(a-b) 
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BASIC SKILLS INSTRUCTIONAL IMPROVEMENT CYCLE 




Reading/L.A. 
or Math 
Classroom 



Implementation 




ERIC 



Selection 

and 
Preparation 
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C. Rationale for focus on time (15-25 minutes) 





Rationale . Common sense and research studies indicate the importance 
of time for student achievement. Participants should understand that 
various measures of time have been studied in . process/product and/or 
experimental research and that as might be expected several of these 
measures have been shown to be significantly related to achievement. 
Measures uaed in information collection (allocated time ( engagement 
rate, and student engaged time) are defined and discuased. 



Materials 



*1H21— Time Glossary; 

(a-b) Selected References 
(£) — Research Findings on 
Time (Appendix C) 
*1U17— Time Definitions 

Worksheet 
*1T18— Answer Key for 1H17 

(D lT16—Flow Chart for 

Computing Student 
Engaged Time 
(£) 1H19—Student Engaged 

Time Worksheet 
(£) 1T20— Answer Key for 1H19 
— Calculator 

Alternative Strategies 



Strategy 

Explain why time is important in 
determining students 1 opportunity to 
learn basic skills. Discuss how the 
program will help locate these 
opportunities. 

Define each of the terms on 1H21. 
Distribute "Research Findings on Time" 
for background information on research 
findings* Have teachers complete 1H17 
independently* 



Show leaders how to use the flow chart 
and have them complete 1H19. 



1. 



Supplementary activities (including the oral presentation of 
research findings and the completion of worksheets relating to 
the measures defined) are included in Appendix C. Leaders may 
wish to use some or all of these activities. 

2. see the alternate agendas in Appendix A. 



Tfc-1. Time important in determining students 1 opportunity to learn 
basic skills (3 minutes) 



Common sense—the mom time you have to learn t the more can 
be learned 




b, Many theories of instruction (Carroll, Bloom, Cooley-Lohncs) 
include notion of time 

c. Research studies show several measures of time arc significantly 
related to student achievement 

Coal of program — locate opportunities for improving instruction in 
basic skills (2 minutes) 

a. Time shown to be an important factor in student achievement 

b. Program will enable each teacher to look at time expenditures 
in his/her classroom 

Various measures of time have been studied (lH21a) (15 minutes) 

a. Allocated time— time teachers set aside for instruction in a 
content area 

(1) Amount of time scheduled or planned for instruction is 
one measure 

(2) However, amount of time planned or scheduled is changed 
by spontaneous! unplanned events that cause variation in 
day-tO'-day opportunity to learrv— records of when 
instruction actually begins and ends verify this 

(3) Measured in minutes 

b. Engagement rate 

(1) Introduction 

(a) 45 minutes of instruction in math provided 

(b) Student not apt to be attending 100% of time because 
of talking, daydreaming, socializing, etc, 

(c) ThuSf another measure for rate of engagement is 
introduced 

(2) Definition 

(a) Percent of allocated time that a class is perceived 
to be actively working, or engaged in, learning 

(b) Or, another measure of engagement rate is the 
percent of students engaged in instruction at any 
given moment of a class 

(3) Measured as a rate (% of allocated time) 

c. Student engaged time 

(1) Amount of time a student is actively engaged in attending 
to academic instruction or tasks 

(2) Student engaged time » allocated time x engagement rate 

(3) Measured in minutes 
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(4) Major influences are allocated time and engagement rate 

(a) If allocated time remains the same and engagement 
rate Is increased, student engaged time increases 

(b) if engagement rate remains the same and allocated 
time is increased, then student engaged time 
increases 

d. Worksheet ( lH17a . 1T18 ) 

© 4. Calculating student engaged time (10 minutes) 

a. Flow chart (1T16) 

(1) Find allocated time in minutes 

(2) Engagement rate = i e W<* 

If assigned 

(3) Student engaged time = allocated time * engagement rate 

b. Worksheet (1H19, 1T20) 
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Materials 

Included in Appendix C are the following supplementary materials: 

CTll Measures of Time 

CH12 Estimate Your Time 

CH13 Time Nomograph 
(a-b) 

CH14 Engagement Rate and Student Engaged Time (Worksheet) 

CH15 Calculating Student Engaged Time (Worksheet) 



1.21 



Flow Chart for Computing Student Engaged Time 



Find allocated 
time in minutes 



t 

Find engagement . 
rate ( ft engaged | 
\# assigned/ 



y 

Multiply (allocated time x 
engagement rate) to find 
student engaged time 
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TIME DEFINITIONS WORKSHEET 



1. Allocated time in math is 

a. the amount of time schools are open. 

b. the amount of time per day the teacher spends on math instruction. 

c. the amount of time per day students attend to math instruction. 

d. the amount of time per day district plans indicate should be 
spent on math. 

e. none of these. 



2, Engagement rate is 

a. percent of assigned students who are actively participating in 
academic content. 

b. productive time divided by teaching day. 

c. student engaged time. 

d. (time allocated to math) divided by (time allocated to reading). 

e. none of these. 



3. Student engaged time in reading is 

a, (number of students attending to math instruction) divided by 
(number of students not attending to reading instruction). 

b, the amount of time devoted to reading by the teacher. 

c, the amount of time a student spends reading. 

d, the amount of time a student is actively participating in reading 
instruction. 

e, none of these. 
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— _ — total number of Rtudents nsBigned 

Student ertftA^cd time* * engagement rati* x allocated time 




CJ 

o 



ho 



Erica Swenson observed Jerry Sato'a first grade class on April 15th. The class was divided into reading 
groups. Between 9 and 10:20 t three reading groups met with Jerry. When, not in a reading group the students 
did reading workbook pages, or listened to and read along with a stovy cape. Find each aspect of time 
indicated below. You may want to use a calculator or the nomograph* 



Tine 


9:15 


9:16 


9:17 


9:18 


9:19 


9:20 


9:21 


9:22 


9:23 


9:24 


9:25 


9:26 


9:27 


9:28 


9:29 


[TOTAL 


if unengaged 
students 


- 

4 


- 

1 


2 


3 


2 


1 


9 


15 


15 


2 


1 


1 


3 


4 


5 I 68 


# engaged 
students 


20 


23 


22 


21 


22 


23 


15 


9 


9 


22 


23 


23 


20 


21 


19 


292 


# assigned 
students 


24 


24 


24 


24 


24 


24 


24 


24 


24 


24 


24 


24 


24 


24 


24 


360 



U5 
*-i 
C 
C 
cr 
3* 
H 

> 

a 
n 
c? 

H 
H 

E2 
K 

i-n 
H 



a) Allocated Time « 



b) Engagement Rate - 



c) Student Engaged Time 



SO 
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1T20 



ANSWER KEY FOR 1H19 



a. 80 minutes 

b. 81% 

c. 65 minutes 
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lH21a 



TIME GLOSSARY 



ALLOCATED TIME— amount of time teacher spends on instruction 

in a subject area 



ENGAGEMENT RATE— percent of students actively working, or 

engaged, in a subject area 



STUDENT ENGAGED TIME— amount of time students are actively 

engaged in a subject area 



STUDENT ENGAGED TIME = ALLOCATED TIME x ENGAGEMENT RATE 



lH21b 
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C,3*d, Student Engaged Time-^Follow Through Classroom Observation Evaluation 



The concept of student time, the research on student engaged time, 
and the data used for comparison purposes in Phase Two of the improve- 
ment approach are derived from the St al lings and Kaskowitz Follow 
Through Classroom Observation Evaluation; 1972-1973 (1974) . 

The Follow Through Evaluation Studies focused on the impact and 
effectiveness of the Follow Through programs of various sponsors (Far iJest 
Laboratory's Responsive Education Program, the University of Arizona's 
Tucson Early Education Model, The Bank Street College Education Approach* 
The University of Oregon Engelmann -Becker Model, The University of Kansas 
Behavior Analysis Approach, High/Scope Educational Research Foundation's 
Cognitively Oriented Curriculum Model, and The Educational Development 
Center's EDC Open Education Follow Through Model). Another intent of the 
studies was to compare the effectiveness of the overall Follow Through 
classroom program with the approach of non~Follow Through classrooms. 

One of the major purposes of the Follow Through Classroom Observation 
Studies was to relate some 600 classroom conditions/process variables to 
student outcome measures (e.g., student achievement in basic skills, in 
reasoning, in self-esteem, etc,)* 

Observation data were collected during the 1972-1973 school year 
from 36 sites. Data from 108 first grade classrooms and 58 third ttrade 
classrooms, both Follow Through and non-Follow Through classrooms, were 
used, (Readers may recall that the Follow Through program was de- 
signed to meet the needs of children from low-income families. A principal 
objective of the program was to sustain and supplement in the early grades 
the gains made by children who had a full year's experience in a Head 
Start or comparable preschool program. These criteria generally deter- 
mined which children participated in the Follow Through Program in an 
individual site, Mote, however, that within individual sites, and across 
sites nationally, differences exist in basic child characteristics 
such as entering ability, preschool experience and language spoken in 
the home,) tfon-Follow Through classrooms were selected so that they 
formed a comparable group of students. The sites ranged in location from 
rural areas to large metropolitan areas. All geographical sections of 
the country were represented. The ethnic composition of classrooms 
varied from no black children to 100% black children. Fifteen sites had 
children who spoke English as a second language. Children entered first 
grade with differing abilities. Class sizes ranged from 15 to 37. 

Classrooms were observed by trained observers on three consecutive 
days during the 1972-1973 school year. A Classroom Observation In- 
strument facilitated the coding of information for about 600 classroom 
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C . 3 . d . — Con t inued 

variables; student engaged time was derived from one of these. 

During first grade, pretest achievement data In reading/language 
arts and mathematics were collected for all students in the fall on the 
Wide Range Achievement Test (WMT). The WHAT — highly correlated with 
the Metropolitan Achievement Test CMAT) — was used for baseline data be- 
cause it was the only test that was administered consistently during 
the first three years of Follow Through. The 1965 version of the test 
was used, and scores in reading, spelling, and arithmetic were obtained 
for entering first graders. 

- In the spring of 1973, posttest data were collected on the Metro- 
politan Achievement Test (MAT) c.1970, Form F. For first grade, the 
Primary I Form scores used were Word Analysis, Total Reading, and Mathe- 
matics. For third grade, the elementary test scores of Total Reading, 
Language, Math Computation, Math Concepts, Math Problem Solving, and 
Total Math were used. 

In summary, achievement data used to compute achievement gains r 
were as follows : 



1st grades 



3rd grades 



Pretest - WRAT 



Fall 1972 



Fall 1970 



Posttest 



MAT 



Spring 1973 



Spring 1973 
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D, Engagement Rate Form (100-110 minutes) 



Rationale . Participants need to know definitions of engaged and 
unengaged behaviors. Teachers who will not be observing need to 
understand how information will be collected in their classrooms. 



Materials 

ifcBV* — Classroom Scan 
for Engagement 
Rate 



*1K22— Definitions of 
(a-b) Categories for 
Engagement Rate 
Form 

ifclH23 — Descriptions of 

Engaged Behaviors 
*1V24 — Examples of 

(a~c) Engaged Behaviors 
ifclH25 — Descriptions of 

Unengaged Behaviors 
*1V26 — Examples of 

(a-c) Unengaged Behaviors 



*1H29 — Classroom 
(a-h) Pictures 



Strategy 

Discuss rationale for systematic 
observation and standard definitions. 
If BV5 was not shown earlier, view it 
now to Illustrate how a classroom is 
scanned when observing. 

Present definitions for engaged and 
unengaged behaviors. Read and discuss 
examples of engaged behaviors on 1H23 
and elicit additional examples. View 
each classroom on videotape (1V24) , 
having participants keep a mental or 
written record of appropriate student 
descriptions* After each classroom 
is viewed on the videotape, stop the 
tape and list the engaged behaviors 
observed in that classroom. Then view 
the list on the tape and compare it 
with your list* If descriptions are 
missing on your list, repeat the tape 
to find these examples* Repeat these 
procedures for the unengaged behavior 
handout and videotape (1V26). 

Describe the classroom that will be 
coded by discussing the Pre-Observation 
Form. Then have participants decide 
whether each student In each picture 
Is engaged or unengaged and label him/ 
her with one of the categories 
indicated on lH29a. Complete the 
first picture as a group, discussing 
the coding of each student's behavior. 
Indicate to participants that some 
students are assigned to reading in 
the next four pictures and that these 
students must be marked with Ar as well 
as a code. Have participants complete 
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Engagement Rate Form — Continued 



Materials 



"Engagement 
Rate Form 
*1T30 — Answer Key for 
(a-g) Classroom 
Pictures 
— Engagement 
Rate Form 



Strategy 

the pictures for 1:24 and 1:26. 
Explain that the last two pictures 
also include students who are pullouts 
or assigned to other subject areas; 
these students should be coded with 
Ao or Po t respectively. Have 
participants complete the remaining 
pictures and check their answers. 
You may want to ask that the total 
number of students in each category 
be recorded at the bottom of each 
page. 

Describe each part of the Engagement 
Rate Form and then complete it for 
the classroom pictures. See Note D.7, 
for a detailed description of this 
activity. Check answers as indicated 
on the note*, If there is a disagree- 
ment over the number of unengaged 
students, show 1T30 to locate students 
coded incorrectly* Then calculate the 
engagement rates for each subject. 



Alternative Strategies 
1. 



2. 



When viewing videotape examples of engaged and unengaged behaviors 
(1V24 and 1V26), stop and discuss individual descriptions. Check 
with descriptions at the end of each clip. 

Additional practice in identifying engaged and unengaged behaviors 
may be obtained by completing the supplementary activity in 
Appendix D. 



*1. Observation (5 minutes) 

a. Appropriate for collecting information on engagement rate 

tb. Observer usually another teacher or an administrator - since 
difficult to observe while teaching 

c. Need for systematic observation and standard definitions 

(1) Similarity between way data are collected in classroom 
and in research base 

(2) Similarity between observers collecting data 
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(3) Assumption — participants already have definitions of 

engaged and unengaged; purpose of training is to refine 
those so that they correspond to research definitions 

d. Steps in process of observing 

(1) Look at each stud&nt 

(2) Describe student 1 s behavior in objective, nonevaluative 
manner 

(3) Match description with definitions and examples provided 

(4) Classify as either engaged or one of five categories of 
unengaged 

(5) Tally on Engagement Rate Form 

e. Classroom situations during which observations may be made ( BV5 ) 

(1) Camera scans middle of sixth grade reading/ language arts 
class student by student to determine number of unengaged 
students 

(2) Classroom is scanned each time in the same pattern in 
order not to skip any students 

Definitions of engaged and unengaged behaviors (|LH22 ) (10 minutes) 

a. Source - Stallings & Kaskowitz Follow Through Study (see 
Appendix C) 

b« Student behaviors during reading /language arts or math instruc- 
tion 

(1) Engaged - doing academic work 

(2) Unengaged - not doing or attending to assigned academic 
work 

(a) Management/ transition 

(b) Socializing 

(c) Discipline 

(d) Unoccupied/observing 

(e) Out of room 

Examples of engaged behaviors (25 minutes) 

-fca* Relationship of teacher providing instruction with student 
engaged behaviors ^1H23) 

(1) Presenting academic information or directions 

(2) Asking academic question 

(3) Giving test 

(4) Listening to student's academic response 

(5) Reading to students 
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*fcb. Engaged student behaviors (1H23) 

(1) Reading academic information 

(2) Writing, drawing, or erasing academic information 

(3) Speaking related to content area 

(4) Listening to teacher or student present academic information 

(5) Watching teacher or another student working on academic 
content 

(6) Manipulating academic materials in an approoriate way 

(7) If appropriate description of student includes both 
engaged and unengaged behaviors at the same time, code 
as engaged (e,g, t looking around the room and writing) 

c. Engaged student behaviors in classrooms 11V24) (15 minutes) 

*K(1) Classroom #A 

(a) Middle of 3rd grade math — discussion of odd and 
even numbers; students have workbooks open 

(b) Appropriate descriptions of engaged behaviors 

(i) Raising hand in response to teacher's question 

(ii) Looking at appropriate page in book 

(iii) Answering teacher's math question 

(iv) Listening to teacher (or student) talk about math 

(v) Writing math content on board 

(vi) Watching student write math content on board 

(2) Classroom #B 

(a) Middle of 4th grade reading with students doing seat- 
work; vocabulary words written on board 

(b) Additional appropriate descriptions of engaged 
behaviors 

(i) Writing in workbook 
(ii) Reading vocabulary words on board 
(iii) Talking to teacher about reading 

(3) Classroom #C 

(a) Middle of 1st grade math — teacher-led total class 
exercise on money 

(b) Additional appropriate descriptions of engaged 
behaviors 

(i) Appropriate use of manipulative math materials 

4, Examples of unengaged behaviors (25 minutes) 

^ca. Relationship of teacher activities with student unengaged 
behaviors (1H25) 
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(1) Managing class and transition activities 

(a) Giving nonacademlc directions 

(b) Giving answers without any explanation 

(2) Social conversation with student 

(3) Disciplining student 



Unengaged student behaviors (1H25 ) 



(1) Management /transition activities 

(2) Socializing 

(3) Being disciplined 

(4) Unoccupied/observing — used If students can not be 
classified in any other subcategory 

(5) Out of room 

Unengaged student behaviors In classrooms (1V26 ) (15 minutes) 
+(1) Classroom #A 

(a) Middle of 3rd grade math — seatwork with teacher 
at desk with Individual student 

(b) Appropriate descriptions of unengaged behaviors 

(l) Reading bulletin boards while waiting for help 
from teacher (M) 

(11) Looking out the door (U) 

(111) Talking to neighbor (S) 

(2) Classroom #B 

(a) Middle of 4th grade reading — teacher-led 
discussion of definitions of vocabulary words 

(b) Additional appropriate descriptions of unengaged 
behaviors 



(1) Being disciplined (D) 
(li) Watching other students being disciplined (D) 



*(3) Classroom #C 

(a) Middle of 1st grade math — transition to new activity 

(b) Additional appropriate descriptions of unengaged 



behaviors 

(1) Handing out materials (M) 

(ii) Waiting for new activity to begin (M) 

(ill) Listening to teacher's directions (M) 

(iv) Listening to teacher 1 s praise for following 
directions (M) 
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^c5. Distinguishing between engaged snd unengaged behaviors—classroom 
pictures ( 1H29 ) (15-20 minutes) 

s. Pre-Observstion Form completeid'by tesclier" beTng~^6T>served 
before observation 

b. First picture, sll msth, 1:22 

c. Next two pictures, msth snd resding, 1:24 and 1:26 

d. Lsst two pictures; msth, resding, pullout, and assigned other; 
1:28 snd 1:30 

e. Last picture, one student goes home sick so number of 
students present changes (no code needed) 

^T6. Description of Engagement Rate Form (15 minutes) 

s D Identification information 

(1) Needed for data snslysls 



(a) 


State # 


(b) 


District // 


(c) 


School # 


(d) 


Teacher # 


(e) 


Coder I 


(f) 


Date 


(8) 


Grade 


too 


Number of students present 


(i) 


Fart of class observed 



(2) Codes protect confidentiality of teacher 

(a) Teacher keeps own code 

(b) Left-hand corner with names cut off after codes 
entered 

b. Directions at bottom of form 

c. Observation times 

(1) lintricH show Lime of day snd part of period covered l»y 
observation 

(2) Entries indicate when observations were made (e*g., every 
minute or two minutes depending on length of period) 

d. Assigned categories 

(1) Categories - reading/language arts, math, other subjects, 
pullout 

(2) Procedure - count students before making each classroom scan 
and enter number in appropriate boxes 
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e. Unengaged categories 

(1) Categories - management/transition, socializing, 
discipline, unoccupied/observing, out of room 

(2) Procedure 

(a) Count unengaged students during observation and make 
tally marks under the spproprlate category 

(b) Add all the unengaged categories for each observation 

f . Engaged categories 

(1) Procedure - subtract subtotal of unengaged students from 
subtotal of assigned students to determine subtotal 
engaged for esch observation 

g. Totals for each subject 

(1) Assigned students 

(2) Unengaged students for each category 

(3) Unengaged students in all cstegorles 

(4) Engaged students 

h. Engagement rate for esch subject - divide total engaged by 
total assigned 

-fct7. Completion of Engagement Rate Form for classroom pictures (1H%9 . 
1T30) (5-10 minutes) 

a. Observation #1 

b. Observations #2-//3 

c. Observations /M-#5 
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Materials 



In addition to the materials Included here, the following will 
be needed : 



BV5 Classroom Scan for Engagement Rate (Appendix B) 
Engagement Rate Form (l) (Forms) 



Included in Appendix D are the 

DH27 Chart of Engaged and 
DT28 Answer Key for Chart 



following supplementary materials: 
Unengaged Behaviors (Worksheet) 



1.39 
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8/25/80 1H22i 
v DEFINITIONS FOR CATEGORIES USED ON ENGAGEMENT RATE FORM^ 



ENGAGED CATEGORIES 
Mathematics 

Student is involved in or attending to instruction in arithmetic, 
numbers, computation, measurement, geometry, word problems, or counting 

Reading/Language Arts 

Student is involved in or attending to instruction in oral/silent 
reading, decoding, comprehension, handwriting, spelling, speaking 
or liste ning ac tivities, li terature, grammar, composition 
UNENGAGED CATEGORIES ~ ~ ■ 

Management/Trans ition(M ) 

Daily, routine classroom activities or preparatory or "in-between" activ- 
ities (e.g., distributing, setting up, or gathering equipment, supplies, 
materials, or furniture; taking roll; cleaning up; putting on or taking 
off coats; standing in line; getting a drink or washing hands in room; 
putting headings on papers; nonacademic directions; getting ready or 
waiting for next activity to begin; waiting for teacher's help; turning 
through pages in book) 

Socializing (S) 

Two or more persons who are interacting socially (e.g., talking, 
whispering, laughing, wrestling, hitting, note passing, walking to- 
gether) 

Discipline (D) 

Adult is reprimanding a student, a student is being punished or stu- 
dent is watching other student being scolded (e.g., one student is 
being scolded and whole class is listening, head down on desk for 
punishment) 

U noccupied/Observing (U) 

Student is sitting or standing alone, wandering about with no evident 
purpose or goal , watching other people or uhassigned activities, or 
playing with materials. 

Out of Room (0) 

Student temporarily out of room (e.g., bathroom, errand, nurse, 
office) 

OTHER ASSIGNED 

Student assigned to subject other than reading/language arts or math 
(e.g., social studies, science, art, music, free time activities, games, 
snack) 

PULLOUT ASSIGNED 

Student(s) regularly assigned out of classroom (e.g., Title I, remedial 
reading, instrumental music, adaptive physical education, chorus, bi- 
lingual instruction) 



1.40 
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Additional Comments on Definitions of Engaged and Unengaged Behaviors 



1. If appropriate descriptions of a student would clearly allow 
classification as either engaged or unengaged, classify the student 
as engaged. 

2. Classify student as unoccupied/observing only if student can not be 
classified in one of the other unengaged categories. 

3. If teacher directions do not contain content information, students 
listening to the teacher are coded in either the management /transition 
or discipline category, depending upon the context. 

4. In situations where the same behavior might be described in different 
ways depending upon the context (e.g. , talking about subject matter 
or socializing), make the best decision possible after looking for 
additional clues and then go on* 

5. Students listening to corrective feedback from the teacher are coded 
as engaged. Corrective feedback occurs when the teacher tells the 
student whether his/her answer is right or wrong and why. A student 
listening to the teacher read answers without explaining them is 
classified in the management/transition category. 
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DESCRIPTIONS OF ENGAGED BEHAVIORS*** 



1H23 



TEACHER STATEMENTS 

If a student was paying attention when the teacher was providing instruction 
in the specified content area, the student would be engaged. The following 
statements are examples of such teacher comments, 

"Tell me how many centimeters are in the first object* How many 
people got 12? Well, you were all wrong. If you don't put your 
ruler right up next to it, boys and girls, you are going to throw 
your measurement off — eventually, you will end up with a few more 
centimeters than everyone else, 11 

"Today, we f re going to look at wor ds that are pronounced alike but 
may be spelled differently and have different meanings, fhese words 
are called homophones, 11 

"The first word on your spelling test is combination* Write 
combination. 11 

"Does the first sentence of a paragraph start at the margin?" 

"Stand back, 11 said the Kangaroo. "I f m going to jump! I hate to 
alarm you, but I don't wish to harm you!' J (Children's story) 

''That's right, John. The answer is water, because the boat was in 
the water." (praise/corrective feedback on academic work) 

T 'Be sure to line up your tens and ones columns in each addition problem." 



ENGAGED STUDENT BEHAVIORS 



Behavior 
Silent reading 



Writing and 
Erasing 

Speaking 



Listening 



Wa tching 



Drawing 



Manipulating 
Hand raised 



ReadinR/LA 

Library book 
Basal story 
Turning a_ page 

Creative writing 
Handwriting 

Sounding* out a word 
Oral reacting 
Two students talking 
about a story 

Story being read 
Student explanation 

of answer to 

exercise 

Another student respond- 
ing to teacher's 
academic question 

A picture beginning 

"R" 



Math 

Textbook 

Worksheet 

Workbook 

Worksheet 
Blackboard 

Answering teacher ' s 
academic question 



Teacher explanation of 

how to use a manipulative 

Teacher praise for good 
academic work 

Teacher solution of 
problem on board 



A square 
Number rods* 



9 

ERLC 



with the letter 
Scrabble letters* 

Response to teacher's academic question 
1.42 

* Manipulating in academic manner 57 



1V24 
(a-c) 



1V24 consists of three videotape clips of three classrooms. 
During each observation scan of a classroom, participants will 
be focusing on engaged student behaviors. 



58 



1.43 



3/20/80 ^ *JL> 1H25 

DESCRIPTIONS OF UNENGAGED BEHAVIORS l^f 

TEACHER STATEMENTS 

If a student was paying attention when the teacher was managing or disciplin- 
ing the class or socializing with the students, the student would be unengaged, 
The fallowing statements are examples of such teacher e^atenuints . 

Management/Transition 

"Today, the Pirates will do workbook pages 13 and 14 and the Phillies 
will do pages 25 and 26, 11 

"The answers are 12, 36, 48, and 200." 

"Group 3, come up for reading. Turn to page 81. Who would like to 
read nice and loud? 11 

"Tomorrow we will be studying measurement in math class. Who can bring 
in some cardboard or plastic milk or juice cartons? 11 

"I like the way Crystal is working quietly* 11 (praise for behavior) 

Socializing 

"Did your team win last night, Ralph?" 
"Marsha, that's a very pretty dress." 

Disciplining 

"Do you know why I'm waiting? That's right, someone is not listening."* 
"if I see you out of your seat again, Sue, you will stay after school!" 
"What are you supposed to be doing, Kevin?"* 

"I think you two could be looking at someone else's book - not just 
sitting there. 11 * 

UNENGAGED STUDENT BEHAVIORS 

If a student is showing the following behavior, she/he would be coded as 
unengaged* 

Management /Trans it ion Unoccupied/ Observing 

Rummaging in desk Staring out the window 

Sharpening pencil Aimlessly wandering around classroom 

Waiting in line at teachers desk Watching another student do a 

Waiting with hand raised for help different assignment 



Out of Room 



Writing name on paper 
Turning pages in book 

Watching a student involved in a Went to bathroom 

management or transition activity Went to nursed office 

Socializing Discipline 

Whispering nonacademic comment Head on desk as punishment 

to neighbor Listening to class, other student, 

Passing notes or oneself being reprimanded 
Watching someone whispering 

q *May be coded as management, depending on context and tone of voice. 
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1V26 
(a-c) 



1V26 consists of three videotape clips of three classrooms* 
During each observation scan of a classroom, participants will 
be focusing on unengaged student behaviors. 
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CODING CLASSROOM PICTURES 




Math Student 



The following set of pictures (lH29d-f) 
Illustrates the activities of each 
student and the teacher at two minute 
Intervals during the last 8 minutes 
of a math class. 

You will be coding each student according 
to the definitions of engaged and unengaged 
on 1H22. At the bottom of each Plcturet the 
number of students assigned to each subject 
Is recorded. Label each student who Is 
assigned to math with one of the following 
codes s 

E - Engaged 

M - Management/transition 

S -* Socializing 

D - Being disciplined 

U - Unoccupied /observing 

0 - Out of the room 
If the student is assigned to reading, write Ar 
before the codes listed above* No code is 
necessary if a student leaves schoolt 




^Am I an 
ArE, 
ArM t 
ArS, 
ArD, 
ArU, 
or 
ArO 




* 



Reading Student 




Science 
Student 



Social 

Studies 

Student 



If the student is assigned to a 
subject other than reading/language 
arts or math, label him/her Ao for 
Assigned other. 



Art 
Student 



If the student is assigned to a pullout 
program, label him/her PO for Pullout. 




Reined lal 
Read ing 
S tudent 



Band 
Student 



Title I 
Student 



Before coding any students, note what the teacher is doing as this may 
affect whether students are engaged. If a student is working on materials, 
assume they are math materials unless indicated otherwise. When you 
complete an Engagement Rate Form for this classroom, the following identi- 
fication information should be put at the top of the form. 





***FACT SHEET*** 




State-03 


Date-10/9/82 


# Present-28 


District-47 


Coder-Your Name 


Part of Class-End 


School-08 


or Code 




Teacher- Cas in i 


Grade- 3 





1.46 



3/19/80 

Teacher Tony Casini 

Observer You 



P RE-OBSERVATION FORM 



lH29b 



subject Math 



Time Interval 1 : 22 - 1:30 
No. of Students Present 28 



Observation Date 



Part of Period 



10/9/82 



beginning 
middle 
*encP 



Record number of students assigned to each category during the observation period. 



Times 



Reading/ 
Language Arts 



Math 



Other Subjects 
Specify : 



Pull- 
Out 



Out of Room 
Specify: 



1:22- 
1:30 



Any student 
not assigned 
to art or 
science nay 
do reading 
when sath is 
completed. 



28 students 
assigned 
math at 
beginning 
of observa- 
tion 



4 students 
in back row 
assigned 
art when 
math is 
completed 

One student 
will do 
science 
when math 
is com- 
pleted 



Towards 
the end 
of the 
observa- 
tion, 4 
students 
go to 
Remedial 
Reading 



3 students 
to Nurse 
for eye 
examina- 
tion 
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Pre-Observation Form (cont'd) 



11129c 



Briefly describe assignments for each subject and free-time activities 
(attach worksheets if possible). 

Reading 

Group 1 



Any student not assigned to art or science may 
croup 2 ^ read or complete reading work when math worksheet 
is done. 



Group 3* j 



Language Arts 



uaj& Students will be completing a worksheet on addition 

with regrouping. Students may use number rods to com- 
plete the worksheet. When students finish the work- 
sheet, they may work in their math workbooks or write 
the worksheet problems on the board. 



Other 



ERIC 



The four top math students who are in the back of the 
room will be cutting out pumpkins for the bulletin board 
when they have finished the math worksheet. One other 
student will complete her science assignment when her math 
worksheet is finished, i.as 
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Tony Casings Third Grade Math Class at New Delpen Elementary School on 

October 9 at 1:22 p,nu 
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BOOKCASE 



Total Number of Students Assignee 
Reading/Language Arts 
Math 28 

Other 

Pullout 



BLACKBOARD 
CODES : 



STORAGE 



Gi 



1.49 



M - Management /Trans it ion 

S - Socializing 

D - Discipline 

U - Unoccupied/Observing 

0 - Out of Room 



E - Engaged 

Po - Pullout 

Ar - Assigned Reading 

Ao - Assigned Other 



Tony Casini's Third Grade Math Class at New Delpen Elementary School 

on October 9 at 1:24 p.m. 
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looking at each 
other and talking 


writing 
on 

worksheet 


watching 
neighbor 
write 


looking at teacher 
and checking answers 
on worksheet 
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look 
te< 


ing at 
acher 


# # f t 

# # f f 
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e a c h e r 
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back to 
teacher 


erasing 
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Total Number of Students Assigned 

Reading/Language Arts 1 r 
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Other 
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STORAGE 
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CODES i 

M - Management /Trans it ion 

S - Socializing 

D - Discipline 

V - Unoccupied /Observing 

0 - Out of Room 
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E - Engaged 
po - Pullout 
Ar - Assigned Reading 
Ao - Assigned Other 



Tony Casini's Third Grade Math Class at New Delpen Elementary School 

on October 9 at 1:26 p.m. 
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CODES: 

M - Management/Transition 

S - Socializing 

D - Discipline 

U - Unoccupied/Observing 

0 - Out of Room 



E - Engaged 

Po - Pullout 

Ar - Assigned Reading 

Ao - Assigned Other 



Tony Casini T e Third Grade Math Class at New Delpen Elementary School 

on October 9 at 1:28 p.m. 
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Math W 
Other 5 
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S - Socializing ?° - Pullout 

D - Discipline Ar - Assigned Reading 

1*52 U - Unoccupied /Observing Ao - Assigned Other 
0 - Out of Room 
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D.l.b. The Validity of Using Teachers as Instructional Time Data 
Collectors 



Richard Marliave and other researchers working on the Beginning 
Teacher Evaluation Study (ETES) at the Far West Laboratory for Educational 
Research and Development in San Francisco have analyzed when it is 
appropriate to have teachers collect instructional time data. In a paper 
presented at the 1977 annual AERA meeting, they stated that teacher 
records of allocated instructional time were judged as acceptable when 
compared with observer records. However, teacher estimates (ratings) on 
student engagement rates correlated with student aptitude but not with 
observer ratings of student engagement rates* 



D.l.c. Student Engaged Time: A Comparison of Data Collection Procedures 

If comparisons to reference materials are to be meaningful, then the 
data collected by teachers and supervisors must be essentially equivalent to 
data collected using the original Stallings and JCaskowitz (1974) procedures. 
For this reason, a small study was made to compare data collected using the 
original instrument with data collected using the newly-developed instruments 
and procedures. 

The participants involved in this study included eleven teachers (grades 
1-6) from three different elementary schools. Each of these teachers was 
participating in a basic skills instructional improvement project, and they 
and their colleagues had been trained to collect classroom data using the 
materials and procedures included in this guide. Data was collected by 
teachers and supervisors on two days for both reading/ language arts and mathe- 
matics. On these same days, an observer trained only in the Stallings and 
Kaskowitz observation system was also collecting data. Estimates of student 
engaged time using these two separate systems (teacher and researcher) were 
then compared using a t-test technique for correlated observations (Winer, 1971). 

The means and standard deviations of student engaged time measures are 
shown below. The correlation between the two sets of measures for reading/ 
language arts was .75; for mathematics the correlation was .78. The correlation 
between individual scores for both subjects over the two-day period was .90. 
T-tests using a paired data procedure indicated non-significant differences 
between the means (t = .28 for reading/ language arts; t = .78 for math; t ns 91 
1.72). ' U:) ' Z1 

Student Engaged Time for 
Reading /Language Arts and Mathematics 
Using Two Observation Systems 





Reading/Language Arts 


Mathematics 


Researcher 


Teacher 


Researcher 


Teacher 


Student Engaged Time 
(minutes) 


106.9 


100.6 


45.0 


37.8 


Standard Deviation 


34.2 


29.5 


15.8 


13.6 



ERIC 



1.62 



f ( 



8/28/80 



The results of the study comparing data collected using both the 
Stallings and Kaskowitz instrument and the instruments used in thii' guide 
indicate that essentially equivalent data are being produced. Of major 
practical importance, however, is that the process used in this guide requi 
thirty minutes of observation in the classroom, whereas the Stallings and 
Kaskowitz procedure requires full-day observations. 



D. 6. a. (1) . (h) . Explanation of Number of Students Present Row on the 
Engagement Rate Form 

The bottom row on the Engagement Rate Form, indicating the number of 
students present during each scan of the classroom, may be used when the 
number of students present changes during an observation. For example, 
on the front of the Engagement Rate Form shown oh the next page, the 
number of students present row is used only when this number changes from 
the initial one recorded at the top of the form. 



Number of 
Students 

Observation(s) Present Explanation 

1-2 30 Number of students present has not 

changed. 

3-6 31 An advanced student from first grade 

comes into the room for reading 
instruction, so the number of students 
present increases by one v 

7-8 32 A tardy student arrives and immediately 

goes to a remedial reading pullout 
„ program, so the number of students 
increases again by one. 

9 31 One of the students assigned to reading 

goes home sick, so the number of 
students present decreases by one. 



The number of students present row may also be used to check that 
all students are assigned to some activity by adding the number of students 
assigned to reading/language arts, math, other, and pullout and recording 
the total in this row; this total should be the same as the number of 
students present recorded at the top of the form. 
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D,7, Engagement Kate Form 



[This note discusses how the Engagement Rate Form should be completed 
for the classroom pictures (1H29) that were previously coded, A completed 
copy of this form may be seen on 1T30.] 

The Engagement Rate Form is a classroom observation Instrument used 
by observers to record data on the percent of assigned students actively 
working In either reading/language arts or math. This form was developed 
to provide practitioners with an Instrument that can be used to collect 
data that is essentially equivalent to the data base (Stalllngs and Kaskowltz 
Follow Through Evaluation Study, 1974). At the top of the front of this 
form, there is a section for Identification Information. In the next 
sections In the middle of the form, data for each observation are recorded 
sequentially. If more than nine observations are made, the second side of 
this form will be used. In the last column on the second side, the engage- 
ment rate in each subject is calculated. The directions for using this 
form are at the bottom of both sides of the form. 

The first section to be completed by the observer involves the 
identification information at the top of the form* In the upper left-hand 
corner, the state, district, school, and teacher are identified. If a 
teacher wishes to share his/her data without revealing its source, this 
information can be coded along the top center of the form; the left-hand 
corner can then be cut away. At the top right are blanks for the date, 
coder number, grade, number of students present, and part of class observed. 
The coder who completes this form will probably be another teacher or an 
administrator, since the classroom teacher will be too busy to code this 
form while he/she is teaching. The number of students present is entered 
at the top of the form if the attendance number in the classroom does not 
change during the observation. If the number of students present changes 
during the observation due to students coming to school late or students." 
from another class being assigned to this classroom for Instruction, the 
number present for each observation will be recorded at the bottom of the 
form in the appropriate column. Usually the observation schedule chosen 
provides for only part of the allocated time to be observed. Then the 
coder would Indicate at the top of the form whether the part observed is 
the beginning, middle, or end of the allocated time, since engagement 
rates may differ among these time periods. 

First the coder completes the identification information at the top 
of the form for the classroom pictures that were previously coded. The 
codes needed to complete this part of the form are given at the bottom of 
the directions sheet for the classroom pictures (lH29a)* 
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D. 7 • --Continued 

Record the codes for the state, district, and school* Then record 
the teacher 9 s name, which he will change to his key code when the 
completed form is given to him* Now record the date, your name or key 
cade for the coder, the grade, arid the number of students prevent. 

On two previous days, the coder observed the beginning and middle of 
a math class. So on October 9, the coder observed the last part of a 
math class. In the far right of the heading, draw a check beside the 
word "end" to indicate the part of the period being observed* 

The numbers of students are recorded in the section of the £orm for 
the subject to which they are assigned- There are separate sections on 
the form for reading/language arts and math. At the bottom of the form, 
there is a section for recording the number of students assigned to 
subjects other than reading/ language arts and math, the number assigned 
to pullout programs, and the number present. This information is useful 
to know when you are selecting strategies in Phase Three of the Cycle. 

Look at the first classroom picture that you coded* Record the time 
the first observation was made (1:22) at the top of the first observation 
column* 

To find out how many students are assigned to each subject, look at 
the bottom of the classroom picture. Since all the students are assigned 
to math at this time, record all the students (28) for the number assigned 
in the first column of the math section in the middle of the page* 

Now count the number of unengaged students who are in management/ 
transition activities during this observation* Since there were 10 
students in management/ transition activities, record 10 next to management/ 
transition in the math section in the first column. 

Count the number of students who were coded as socializing during 
this observation* Since 9 students were socializing, enter this number 
next to socializing in the first column in the math section* 

Now count the number of students who were coded as being disciplined, 
unoccupied/observing, or out of the room* Record these numbers beside 
the appropriate categories in the first column of the math section 
(discipline - blank, unoccupied - 1, out of room - 3). 

To find the total number of unengaged students, add the numbers i"t 
each unengaged category do + 9 + 1 + 3) and record this number (23) in 
the Total Unengaged row in the first column of the math section* 

To find the number of engaged students, subtract the number unengaged 
(23) from the number assigned (28)* Record this number (S) in the row 
labeled Engaged in the last box in the first column of the math section* 
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D. 7. — Continued 

During the second observation, all the students were not assigned to 
math. One student finished math work and bogan reading work. Therefore 
this student will be recorded at the top of the form In the reading/ 
language arts section. Record 1 for this student in the Aeoigned row of 
the reading section. Since thie student was coded as unengaged in a 
management/ transition activity, record a 1 in this category in the second 
column of the reading section* Then total the number of unengaged (1) 
and record it in the Total Unengaged row of the reading section* Subtract 
the total unengaged (1) from the number assigned (1) to find tha numbcx* 
engaged* Record the number engaged (0) in the second column of the 
reading section in the row labeled Engaged* 

Now data for the math students during the second observation at 1:24 
will be recorded. Record the number of students assigned and the number 
unengaged in each category* Total the number unengaged and subtract to 
find the number engaged* 

Complete^ the column for the next observation by recording the data 
in the reading and math sections* 

During the fourth observation at 1:28, four students had gone to a 
pullout program, remedial reading, and four students had been assigned to 
another subject, art. At the bottom of the form in the fourth column, 
record the four art students in the Other Assigned row and the four 
remedial students in the Pullout Assigned row* 

How record the number assigned,, the number unengaged, and the number 
eyigaged in the reading section of this column* Then record the data for 
the math section* 

Now complete the form for observation 5. One student goes home sick 
during this observation* Since the number of students present changes to 
2? 3 the bottom row of the Engagement Rate Form should be completed* 

Before the engagement rates may be calculated, each row must be 
totaled, In the reading /language arts section, add across the Number 
Assigned row and record this total in the last box in the row* Then add 
each of the Unengaged rows and the Engaged row and record the totals in 
the last box in each row* 

iJow total each row in the math section* 

Total the Assigned Other and Vullout raws at the bottom of the forn\ 

To find the engagement rate for reading/ language arts,, divide the 
total number engaged during reading/ layvguage arts by the total number 
assignea to this subject* 

To find the engagement rate for matn 3 etivtae vne zozau mwoer engagea 
in math by the total number assigned to math* 

t!ou check your answers on IT 30. 

If you forget how to complete this form, refer to the directions at 
the bottom of both sides of the form. 
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E. Observer training on the Engagement Rate Form (1-3 hours) 



Rationale . Observers need to know how to use the Engagement Rate 
Form in order to collect information accurately. 

Materials Strategy 

Decide before the session which tapes 
are most appropriate for use. Class- 
room A is a fourth-grade teacher- 
directed reading/ language arts lesson; ; 
the first scan includes a wide range 
of unengaged behaviors and is somewhat 
difficult to code, while the remaining 
scans are much easier to code. Class- 
room B shows third-grade math seatwork, 
while Classroom C is a first-grade 
teacher-directed math lesson. If only 
one tape is to be coded, you may wish 
to discuss the first scan of lV32a in 
detail and then code either lV32b or 
lV32c. 

Discuss the classroom diagram and 
teacher comments before viewing each 
tape* When viewing the first classroom^ 
point to each student as the camera 
moves down each row, having partici- 
pants mark the correct coding fair each 
student on the blank classroom diagrams; 
this ie particularly important with 
lV32a* Put the "still-frame" on each 
row so participants will have time to 
observe each student* 

View each student only once; if he/she 
moves or changes activities, do not 
change the code. Remember to code 
students who are moving around the 
room once* Check answers for each 
student at the end of each observation. 
The correct coding of each student 
is shown in Noi.2 E.l. When disagree- 
ments arise during coding, first get 
agreement as to proper descriptions of 
student behaviors, and then refer to 
the definitions (1H22) for the proper 



®1V32 
a, b, 
or c 




1H31 — Blank Classroom 
(a-r) Diagrams 
1V32 — Discr iminat ion 
(a~c) of Engaged and 
Unengaged 
Behaviors 
—Engagement 

Rate Forms (3) 
— Calculators 
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Observer training on the Engagement Rate Form — Continued 



Materials 



®1V 33— Independent 
Practice in 
Observation 
— Engagement 

Rate Form 
— Calculators 
®1T34— Answer Keys 
(a-j) for 1V32 and 
1V33 



Strategy 

categorization. If major disagreements 
or difficulties still occur after obser- 
vations for the first classroom are com- 
pleted, use the diagrams for a second 
classroom and repeat the same process. 
When disagreements are minor (partici- 
pants are within the indicated range for 
engaged students in 4 out of 5 observa- 
tions) and participants are comfortable 
with the definitions, have participants 
complete the Engagement Rate Form from 
the classroom diagrams. Have partici- 
pants independently code the remaining 
classrooms directly on the Engagement 
Rate Form without using the classroom 
diagrams, first providing the 
identifying information at the top of 
the form. Check answers by checking 
all entries after each observation 
(should be within range given in 
key), the total number of students 
engaged over all observations (should 
be within the range given in key), and 
the rank ordering of the frequency of 
behaviors in the unengaged categories. 
If classroom diagrams are used for all 
three classrooms, have participants 
code classrooms B and/or C again 
directly on the Engagement Rate Form. 

Have participants independently com- 
plete an Engagement Rate Form for this 
videotape. In order to get a realistic 
sense of recording observations, have 
participants complete the first five 
observations before discussion begins. 
Put the "still- frame" on each row or 
part of a row so participants will have 
time to observe each student and record 
tally marks or numbers on their forms. 
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Observer training on the Engagement Rate Form—Continued 



Materials Strategy 

At the end of the first five observa- 
tions, have participants total the 
rows and calculate the engagement rate. 
Then have them check their form. See 
Note E.2 for the correct coding of each 
student. Participants meeting criterion 
(within range for number engaged for A 
out of 5 observations and within range 
for total engaged) on th is tape are 
ready for the demonstration of mastery 
activities; others should go back and 
review areas in which errors were made 
and code the remaining four observa- 
tions on the tape. 

Note: Watching videotape is very tiresome. Be sure to plan sufficient 
breaks so fatigue does not become a problem. 

Alternative Strategies 



1. 



2, 



3. 



4. 



5, 



When coding videotapes using classroom diagrams ClH3l) t only record 
unengaged behaviors. 

When observing, the categories of management/transition, 
socializing, discipline, unoccupied/observing, and out of room may 
be omitted on the Engagement Rate Form and only total unengaged 
recorded for each observation. The advantage of this strategy is 
that it is quicker and easier to code the form. The disadvantage 
is that the teacher will not have detailed information helpful in 
making decisions about program observations in Selection and 
Preparation. 

Participants will probably proceed at different rates in learning 
to use the Engagement Rate Form. One strategy that may be useful 
in accommodating these individual differences is meeting in small 
groups with a leader for each group; this will require one video- 
tape machine for each group. 

If participants use the blank diagrams for coding all three class- 
roams in 1V32 or if additional practice is desired, you may wish 
to use one or more of the five observation clips included on the 
Supplementary Tape and described in Appendix E. 

You may wish to break up videotape training by completing the 
activities in Topic G (Allocated Time Log) and/or Topic H 
(Scheduling) . 



tl. 




Videotape of three classrooms (1H31, 1V32 . 1T3A )^ 
a. Blank classroom diagrams 

(1) Numbers show order in which students are coded and 



(2) 



location of each 
Same number is not always same student 



ERJC 



1.70 
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b. Five observations in each room 

(1) Beginning of fourth grade language arts — teacher-directed 
whole class lesson on comma and apostrophe rules; a 
worksheet is handed out, and whole group lesson on sheets 
proceeds 

(a) Teacher — Green 

(b) Date— 11/14 

(c) Number of students present — 28 

(d) Time observations begin — 1:45 p.m. (at two minute intervals) 

(2) Middle of third grade math — seatwork and free time math 
activities; teacher is working with individual students 
at her desk 

(a) Teacher — Jones 

(b) Date—4/17 

(c) Number of students present — 16 

(d) Time observations begin — 1:05 p.m. 

(3) Middle of first grade math—teacher-led whole class 
instruction on subtraction with some students doing 
problems at board; students begin math seatwork; there 

is one pullout student and one student out of room during 
observation #5 

(a) Teacher~Valde2 

(b) Date— 11/19 

(c) Number of students present — 27 

(d) Time observations begin — 1:15 p.m. (at two minute 
intervals) 

<S)t2. Independent videotape practice for one classroom 

a. Beginning of first grade math class — teacher-directed whole 
class lesson on counting by twos; some students are counting 
beans at desk and one student walking on number line in front 
o f room 

b. First five consecutive observations of class completed at 
one-minute intervals 

c. Identification information 

(1) Teacher — Smith 

(2) Date—4/16 

(3) Number of students present — 20 

(4) Time observations begin — 12:30 p.m. 

d. Last four observations completed at one-minute intervals 
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MATERIALS 

In addition to the materials included here, the 
following are needed; 

Engagement Rate Forms (4) (Forms) 



• 
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lH31a 

Pre-Observatlon Form for Classroom A - Grade 4 




Teacher 



Cathy Green 



Observer 



2 minutes 



Time Interval 



No* of Students Present 



Subject Reading /Language Arts 

Observation Date November 24 

Circle < feeginning[) 
Part of Period middle 

end 



Record number of students assigned to each category during the observation period, 



Times 



Reading/ 
Language Arts 



Math 



Other Subjects 
Specify: 



Pull- 
Out 



Out of Room 
Specify: 



1:45 



28 students 
assigned to 
reading/ 
language arts 




Pre-Observation Form (cont'd) 



Briefly describe assignments for each subject and free-time activities 
(attach worksheets if possible). 



Reading/Language Arts 

This class Itas been Dorking on punctuation activities* At the beginning 
of the observation the students are putting Jieadings on their worksheets* 
Then I begin a whole group lesson on punctuation* 
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HINTS FOR CODING CLASSROOM A 



17 



16 



20 



23 



24 



26 



28 









L8 






22 


21 






27 25 
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12 U 10 * 














i5 


14 


13 





The classroom' s arrangement and general 
viewing pattern for coding are shown. 
After the first clip the third row of 
students (#9-#12) is observed in the 
reverse order. 

The teacher makes the following comments; 
"Put your name on all pages,,. Now, I 
don't have to explain this, because you 
have-*" 

Observation #1 

"You know that we have been doing the- 
ah-punctuation. We did punctuation 
activity 1 with these skills. Three 
general rules follow for comma rules 
and for the use of the comma* Now, if 
you look in //l, after the salutation 
of a friendly letter. The salutation is sometimes also called the? ...Greeting. 
That's rule one* Rule two: to separate words in a series. Excuse me, some of you 
aren't paying attention. ...You can't pay attention and watch that, too. Number 
three: to separate month and year, to separate names of city and state." ... 

Observa tion if 2 

"Which rule would that be? ... Yvette? ... Separate a month and year? ... Tina? . .. 
To set off certain phrases in sentences? It's not setting off a phrase. Look at, 
look at them carefully. What do you think it is, Bill? ... you don't have a yes 
or a no in that sentence. You're guessing, you T re guessing. Now what do you think, 
Sid? . .. Six, because the quotation is what? What Is the word quote, the quote 
there? What is quoted there? ... Stop. That T s a quotation. All right, read the 
next phrase. All right, Simon. ... All right, look at your rules carefully. You 
have nine of them* Look at them carefully and sea why the comma or apostrophe, 
whatever is in that sentence." ... 

Obse rvation #3 

"A what? ... All right, what rule is followed? ... What rule is followed? ... What? 
Michael. ... One? That's what you use with a letter. That's after the greeting of 
a friendly letter. Next one, read it for us please, Dennis? ... All right, what: 
is used in that? Joanne? ... All right, what is the rule? The rule is what? ... 
Separating the month and year. Very good, Beth. ... And what is the rule? ... 
Nine, possession. What is it that belongs to Bill? ... A book. All right." ... 

Observation #4 

"The certain phrase, after walking four hours. Now the punctuation is missing in 
the bottom. To do this very, very quickly. #1. You have 2 sentences in each box. 
Read each one silently. I'll give you a second or two to read #1, box one. Find 
out which one needs a correction or whatever for the rule. ... Read the two 
sentences for me, Paul. ... All right, now which one, which part of what do you 
think is needed? Richard? ... Number what? You need a comma after what word ? 





After what? 



No. 



Observation #5 

"Ail right, very good. You should have a comma between? ... Very good. Four, urn, 
what? Haavens! B^rnadine, would you read this for us, please? Bex four. ... Now, 
^here do you think you need something there? ... #1, very good, you need it where? 
... Right, after "Dear Mary." Box 5. All right, Lee. ... All right. ... Ok, #2. 
What's wrong with 2? Look at "can't." ... It's not a comma, it's ah? ... 
Apostrophe. Ok, good. All right, 6." ... 
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BLANK CLASSROOM DIAGRAMS 
lV32a— Observation Hi 



lH31c 



TEACHER'S 
DESK 



20 

23 
24 
26 
28 



17 



16 







19 18 






22 21 






27 25 







7 6 3 2 












8 5 4 1 














12 11 10 9 














15 14 
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"You know that we have been 
doing the-ah- punctuation. 
We did punctuation activity 
1 with these skills. Three 
general rules follow for 
comma rules and for the use 
of the comma. Now, if you 
look in #1, after the 
salutation of a friendly 
letter. The salutation is 
sometimes also called the? 
...Greeting. That's rule 
one. Rule two: to separate 
words in a series. Excuse 
me, some of you aren't 
paying attention. ...You 
can't pay attention and 
watch that , too . Number 
three: to separate month 
and year, to separate names 
of city and state." ... 
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TEACHER'S 
DESK 



17 16 



lV32a — Observation #2 



7 6 3 2 



20 

23 

26 
28 








19 18 






22 21 






27 25 
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9 10 11 12 
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14 
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"Which rule would that be? 
... Yvette?, Separate a 
month and year? ... Tina? 
...To set off certain 
phrases in sentences? It's 
not setting off a phrase. 
Look at, look at them care- 
fully. What do you think 
it is, Bill? ... You don't 
have a yes or a no in that 
sentence. You're guessing, 
you* re guessing. Now what 
do you think, Sid? ... Six, 
because the quotation is 
what? What is the word 
quote* the quote there? 
What is quoted there? ... 
Stop. That's a quotation. 
All right, read the next 
phrase. All right , Simon. 
... All right, look at your 
rules carefully. You have 
9 of them. Look at them 
carefully and see why the 
comma or apostrophe, what- 
ever is in that sentence. 11 
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BLANK CLASSROOM DIAGRAMS 
lV32a--Observation #3 



lH31d 



TEACltEft'S 
DESK 



20 
23 

24 j 

26 

28 



17 16 







19 18 






22 21 






27 25 
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9 


10 


11 


12 














15 


14 
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"A what? ... All right, 
what rule is followed? ... 
What rule is followed? ... 
What? Michael. ... One? 
That's what you use with a 
letter. That's after the 
greeting of a friendly 
letter. Next one, read it 
for us please, Dennis? ... 
All right, what is used in 
that? Joanne? ... All 
right, what is the rule? 
The rule is what? ... 
Separating the month and 
year. Very good, Beth. ... 
And what is the rule? ... 
Nine, possession. What is 
it that belongs to Bill? 
... A book. All right." 
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lV32a — Observation H 



D*SX 
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"The certain phrase, after 
walking four hours. Now 
the punctuation is missing 
in the bottom. To do this 
very^ very quickly. #1. 
You have 2 sentences in each 
box. Read each one silently 
I'll give you a second or 
two to read #1, box one. 
Find out which one needs a 
correction or whatever for 
the rule. ... Read the two 
sentences for me, Paul. ... 
All right* now which one, 
which part of what do you 
think is needed? Richard? 
... Number what? ... You 
need a comma after what 
word? ... After what? ... 
No." ... 
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BLANK CLASSROOM DIAGRAMS 
lV32a— Observation #5 



lH31e 




mCHEH'3 
DESK 



17 16 



7 6 3 2 



20 
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"All right, very good. You 
should have a comma between? 
... Very good. Four, urn, 
what? Heavens! Be mad in e , 
would you read this for us, 
please? Box four. . . . Now, 
where do you think you need 
something there? ... #1, 
very good, you need it where? 
... Right, after "Dear Mary." 
Box 5. All right, Lee. ... 
All right. ... Ok, 02. 
What*s wrong with 2? ... Look 
at "can*t." ... It*s not a 
comma, it T s ah? ... 
Apostrophe . Ok, good. All 
right, 6." ... 
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I BUCKUOAKO" 
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lH31f 

9/11/79 Pre-Obscrvation Form for Claaaroom B - Grade 3 

Teacher Suean * j0nee Subject Math 



Observer Observation Date April 1? 



Time Interval 1 minute Circle beginn ing 



* * j * n 16 part of Period Qnid dl* 

No. of Students Present JV x - 

end 



Record nucibcr of students assigned to each category during the observation period. 



Times 


Reading/ 
Language Arts 


Math 
* 


Other Subjects 
Specify : 


Pu^l- 

o*it 


Out of Room 
Specify: 


I J 05 




16 students 
assigned to 
math 










Pre-Observation Form (cont'd) 

Briefly describe assignments for each subject and free-time activities 
(attach worksheets if possible). 



Math 

Jzudents are doing math seatwork and/or math free-time activities. 
T will be working with students individually at my desk. 



1.78 
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HINTS FOR CODING CLASSROOM B 



The classroom's arrangement and the general pattern for coding are shown 
In the diagram. Students at the teacher's desk are coded first. The 
second row Is scanned In reverse order In observation #5. 




12 
11 
10 
9 






16 

Book oook 



Teacher's 
Desk 



Emptv Desk 



The teacher is working with students Individually throughout the 
observations. 



1/79 
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BLANK CLASSROOM DIAGRAMS 
lV32b— Observation #1 



lU31h 





lV32b--Observation #2 




3/21/80 



BLANK CLASSROOM DIAGRAMS 
lV32b— Observation #3 



1U3U 




No pertinent teacher 
comments. 



lV32b--Observation #4 



15 
14 





16 

Euo!; lio.tU 



*1 



L 



8 
7 





No pertinent teacher 
comments* 



Teacher f & 
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Already counted; do not code 
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BLANK CLASSROOM DIAo|rAMS 
lV32b--Observation #5 



lH31j 




No pertinent teacher 
comments. 




0 

ERIC 




"Empty Desk 



1.82 



*™Already counted; do not code 
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P re-Observation Form for Classroom C - Grade 1 



Teacher Uosita Valdez 



Subject Math 



Observer 



Time Interval 2 minutes 



No* of Students Present 



2? 



Observation Date November 19 

Circle beginni ng 
Part of Period Cjtiddle^ 

enc 



Record number of students assigned to each category during the observation period. 



Tines 


Reading/ 
Language Arts 


Math 


Other Subjects 
Specify: 


Pull^ 
Out 


Out of Room 
Specify: 


1:13 




2? students 
assigned to 
math 








1:21 

• 








1 student 
leaves for 
Title I 





Pre-Observation Form (cont'd) 



Briefly describe assignments for each subject and free-time activities 
(attach worksheets if possible). 



Math 

I will be leading a whole-class lesson on subtraction; workbook sheets 
have been handed out to students. Several students will be solving 
problems at the board at first* Then the students will be working 
independently in their workbooks* I will be circulating to help those 
students having difficulty 9 
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HINTS FOR CODING CLASSROOM C 



1H31Z 



BOOKS 




3 



B 

12 



7 

11 



6 
10 



16 



IS U 13 







- 


X 











20 



21 



23 



2U 
2&- 




windows 



The classroom's arrangement and the general 
pattern for coding are shown In the diagram* 
The third row of desks (013-016) Is coded In 
reverse order In observation 03, and the 
fourth row (017-019) Is coded In reverse order 
In observations 02-04. There Is one pullout 
student and one student out of room during the 
last observation. 

The teacher makes the following comments: 

Observation 01 

"When I see someone sitting especially nice, 
then 1*11 know that you are ready for a turn 
to come up and do a problem. ... X can tell 
there are a lot of people that aren't going 
to be ready to come up to the board. . Ok, 
maybe Amy can come up and pick a problem and 
Jennifer can also come up and find a 



sea If she can find the answer to It. 

problem... (PA announcement) and I think that... Jason can go up and find a problem., 
and Llsette may tlnd a problem and Tammy may find a problem.*' ... 

Observation 02 

"Ok, Eugene, let's take a look at this first problem while we're waiting for the 
rest of the answers. ... Would you please read It for us? ... How would you read 
this If you looked at It? ... Sorry, I'm sorry, but I don't appreciate calling out, 
Eugene... Thank you. Jason, sorry I had trouble hearing It because you were talking 
You may sit down,.. Ok, Eugene, is this the right answer. . .No. . .Eugene. . .Lisa , I'm 
talking to Eugene. Thank you. Eugene, would you please tell us what you think 5 
takeaway 2 equals. •• 7. • .Nancy said, "Ho." Nancy, do you know... Excuse me, Tammy, 
Nancy, do you know what Eugene Is doing when he Said, "5 takeaway 2 equals 7... He 
thinks It's plus. Remember, Eugene, this sign means that we start out with five 
things. ..circles, ok, Eugene. Let's start out with five. ..then It tells us to 
takeaway 2. Ok, you want to come up and takeaway 2? Erase 2 of those circles, so 
we don't have them anymore." ... 

Observation 03 

"It should be 2. ... Let's watch, ok, this time we'll have four boxes. Ok, X need 
Tanya. ..to come up and take away 3. ... Erase 3 of them. • • Jasoa. ... Ok, how many 
are left? ... 1. 4 takeaway 3 equals what...l, ok. Thank you, Jason. ... Ok,.. 
. Mark... Why Is this answer 3... Ok, sit down, ok... When you take away 0, you're 
not taking anything away. So 3 takeaway 0 Is 3. ... 0k, let's see If pictures can 
help us. 0k, this time we'll try triangles. Here's 3 of them and It says don't 
takeaway anything. ... So let me put uhe eraser down, shouldn't I. • .equals •• • 0k, 
If I put my raser down and I don*t use It how many are left? ... 3 takeaway 3 
equals ... 3 takeaway 0 equals 3.'* ... 

Observation 04 

"Wc' re going to do what the problem tells us. Ivory Is going to do It. We're 
starting out with 2 boys... Then It says we're going to take them away. They're 
going out and play..* They don't want to be in here, so let*s taHe both of them away 
Ivory... How many are left? ... Nothing, zero, ok, we have a little too much help up 
here. I don't think we quite need It. Thank you very much, Ivory, ok. Would you 
believe, please, now, let's see If we can do the same kind of problem by ourselves 
and let's turn to page 90... Page 90. You'll find on page 90 that we're going to 
have to. ..be very careful. ... The book Is going to try to trick you. It's going to 
have some plus problems and some takeaway problems. ... By yourself, very quietly, 
I'd iike you to see If you can do that page. I don't want anyone looking at anyone 
else*s paper." ... 

0b s e r va t io^ r JX 

"Sit down... 0k, Jason get busy... Lisa, have you started?. • '< 
nice -job. ••" 

1,84 



Amy's doing a very 



9 
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BLANK CLASSROOM DIAGRAMS 
lV32c — Observation #1 




UOOKS 




"When I see comeone sitting especially 
nice, then I'll know that you arc 
ready for a turn to come up and do a 
problem. ... I can tell there are a 
lot of people that aren't going to be 
ready to come up to the board. . ** Ok, 
maybe Amy can come up and pick a 
problem and see if she can find the 
answer to it. Jennifer can also cone 
up and find a problem. .. (PA announce- 
ment) and I think that... Jason can go 
! up and find a problem. . .r.nd Lisette 
may find a problem and Tammy may find 
a problem." . . . 



WINDOWS 




lV32c — Observation #2 



.12_. 



16 



O.7. 



20 



22 




__JJ JLQ„.. 



..-2 



I .„ 
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.02.. 
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25 
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u 
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u 
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— Empty Desk 
* — Already counted; do not code 
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"Ok, Eugene v let's take a look at 
this first problem while we're waiting 
for the rest of the answers. ... Would 
you please read it for us? ... How 
would you read this if you looked ai. 
it? ... Sorry, I'm sorry, but I don't 
appreciate calling out. Eugene... 
Thank you. Jason, sorry 1 had trouble 
hearing it because you wera talking. 
You may sit down... Ok, Eugene, is this 
the right answer. . .No. . .Eugene. . .Lisa , 
I'm talking to Eugene. Thank you. 
Eugene, would you please tell us what 
you think 5 takeaway 2 equals *.« 7 •• • 
Nancy said, "No. 11 Nancy, do you know 
...Excuse me, Tammy, Nancy, do you know 
what Eugene is doing when he said, "5 
takeaway 2 equals 7... He thinks it's 
plus* Remember, Eugene, this sign means 
that we start out with five things... 
circles, ok, Eugene. Let's start out 
with five... then it tells us to takeaway 
2. Ok, you want to come up and takeaway 
2? Erase 2 of those circles, so we 
don f t have them anymore." 
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BLANK CLASSROOM DIAGRAMS 
lV32c — Observation #3 



__J£OOKS_ 
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"it should be 2. 

this time we'll have four bdxes. 
need Tanya.., to come up and take 
. . . Erase 3 of 
many are left? 



to 
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Let's watch, ok, 

Ok, I 
away 3< 

them. . .Jason. ... Ok, how 
. . . 1. A takeaway 3 




equals what...], ok. Thank you, Jason. 
. .* Ok... Mark... Why is the answer 3... 
Ok, sit down, ok... When you take away 
0, you're not taking anything away. So 
3 takeaway 0 is 3. ... Ok, let's see if 
pictures can help us. Ok, this time 
we'll try triangles* Here's 3 of them 
and it says don't takeaway anything. ... 
So let me put the eraser down, shouldn T t 
I. . .equals. . . Ok, if I put my eraser 



y — v. down and I don T t use it how many are 



(Tal,lo) left? 
\T 7 away 



. .. 3 takeaway 3 equals 
equals 3." . . . 



3 take- 
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lV32c™Observation //A 

,f We f re going to do what the problem tells 
us. Ivory is going to do it. We're 
starting out with 2 boys... Then it says 
we're going to take them away. They're 
going out and play... They don't want to 
be in hert, so let's take both of them 
away, Ivory... How many are left? ... 
Nothing, zero, ok, we have a little too 
m u ch help up here. I don't think we 
quite need it. Ihank you very much, 
Ivory, ok, Would you believe, please, 
now, let T s see if we can do the same 
kind of problem by ourselves and let T s 
turn to page 90... Page 90. You'll find 
on page 90 that we're going to have to* . • 
be very careful. ... The book is going 
to try to trick you. It f s going to have 
some plus problems and some takeaway 
problems. . ( . By yourself t very quietly, 
I f d like you to see if you can do that 
page. I don't want anyone looking at 
anyone else's paper." ... 
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* — Already counted; do not code 
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BLANK CLASSROOM DIAGRAMS 
lV32c--Observation #5 
(1 pullout; 1 student out of room) 
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"Sit down... Ok, Jason get busy 
Lisa, have you started?... Amy' 
doing a very nice job..." 
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^><^ — Empty Desk *Already counted; do not code 

1.87 

10? 



3/21/80 



lH31p 

Pre-Observacion Form for 1V33 * Grade 1 



Teacher 



Ann Smith 



Observer 



Subject Math 

Observation Dace April 16 



Time Interval l minute 



No* of Scudencs Present 



20 



Circle *^Tbe ginning*^) 
Pare of Period middle 

end 



Record number of scudencs assigned co each cacegory during che observacion periofl. 



Times 


Reading/ 
Language Arcs 


Mach 


Ocher Subjeccs 
Specify : 


Pull- 
Ouc 


Ouc of Room 
Specify: 


12:30 




20 students 
assigned to 
math 









Pre-Observacion Form (conc*d) 



Briefly describe assignraencs for each subjecc and free-cime accivicies 
(accach vorksheecs if possible)* 

Math 

I will be teaching a whole-gvoup lesson on counting by twos. Most 
students will be counting beons at their desks. Three students will 
be at the front of the room—walking on a number line, writing on 
the board* and using demonstration materials. 



1*88 
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HINTS FOR CODING 1V33 



lH31q 



■UeVboiitj ' 



11 



t Lla* 




IK 



The classroom's arrangement and the 
general pattern for coding are shown. 

The teacher makes the following 
comments : 



Observation Si 
The teacher Is presenting academic 
Information. 



o 



TtbU 



Observation #2 " 
"He started at 0, and he went over to 2, ok, and he stopped at 2. Now, can you take 
2 more steps? Where are you going stop this time, Kenneth? ... 4. All right. So 
put another set of 2, everybody, 4. How about 2 more ateps? Now where are you? ... 
6. Ok, 2 more. ... Up to 8. Do you have your sets of 8 out? You should have 2,4, 
6,8. Ok. Keep them In sets of 2, keep them In sets of 2. Let's keep them so they're 
In sets of 2. All right. Just like Shawl's doing. See how he has his In sets? 0h» 
you can't see them. I'm going to have to change thoae. So you can see them In sets 
of 2. You have the right number, dear, but let's fix them so that you see them In 
sets of 2. Ok? ... No, you should have 8. Let's get 2 more. Everybody have 8 now?" 

Observation 03 

The teacher Is presenting academic Information. 
Observation M 

"You point to each set of 2. Now how about coming back here and as they count In 
2s, you are going to walk In 2s. All right, ready, 2,4,6,8,10,12. I didn't say 
put them all out again, just leave them out Ilka they were, and point to the sets 
of 2 as we count them. We're going to have to do It again. Everybody have their sets 
of 2s out? ... Ok, let's leave them like you had them before, David. Ready, go. 2, .. 
Walt a minute, wait a minute, Penny's not ready. Come back and jump for us again." 

Observation #5 

"All right, ready. 2,4,6. Are you counting along? 12. All right, you want to 
try It again? Kenny? And everybody, let's watch him and let's go and point to your 
own sets of 2. You ready, Kenny? 2,4,6,8,10,12. ... Woop, we're going to have to 
keep doing It here, everybody's not doing It yet. Get your 2s out and point. May- 
be this time It will be more fun If you put your fingers on the two of them. Put 
your 2 fingers on them like this. Go on that way. Some of you have been doing It 
all along. Ok?" 
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lH31r 




TEACHER COMMENTS FOR 1V33--CONTINUED 



Observation #6 

"Maybe It will be more appropriate If you will put your two fingers on 
thero like this, like you have been doing It all along. Let T s try It 
again. Ready -2,4, 6, 8, 10, 12. Does anybody know what would come 
next? ... We're counting by 2s. ... No, that would be counting by Is; 
lt T s one higher. Kenny? ... 14? ... All right. You want to jump to 14 
for us? What's going to come after 14 If we T re counting by 2s? Maryanna 
... 16. All right, who can guess what T s going to come next? Judy... 
18. What will come next, Richard?" ... 

Observation #7 

"No, that's counting by Is again. 20. All right. Does anybody think 
they know what's going to come after 20? What's It, Richard? ... 22. 
What's going to come after that? Jeff ... 24. Mike, do you know what's 
going to be next? ... 26. What's going to be next? ... What's going to 
be next? ... 28, what's next? ... No, that's by Is again. No, 30. ... 
What's going to come after 30? ... No, that's by Is again." ... 

Observation 

"32. ..34... No, that's by Is again. .. 36. . . No, that's by Is. 38, ok. 
What comes after 38? ... 40. All right, let's all start with zero and 
go all the way up. Count with us here even though you're only counting 
to 16. Ready. All right, you can go counting up to 12, Shawn, you'll 
point to 12. Ready, 0, 2. Everybody start with zero. 0, 2, 4, 6, 8, 
ttt Uh, uh, uh, 10." ... 

Observation #9 

"12, 14, 16, keep going, 18, 20. All right, very good. You people may 
go back to your seats. Let's look at the page where at the top you'll 
see the Indian feather. It says "How Many?" How many? On the first 
Indian band, how many feathers, David? ... So write your 2 underneath. 
See If you can fill In all the Indian feathers counting by 2s." > 
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1V32 
(a-c) 



1V32 consists of three videotape clips of three classrooms. Each clip 
provides five scans of each classroom for coding on the blank classroom 
diagrams (1H31) or on the Engagement Rate Form. 
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1VS3 



1V33 consists of one videotape clip including ten scans of a single 
classroom for use in practicing coding. 
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(First Five Observations Only) 



lT34g 





STATE 








ENGAGEMENT RATE FORM 






DISTRICT 












, PART OF 
GRADE 1 CLASS 




SCHOOL 




STATE*, 


OS 


SCHOOL # 0% DATE ^'Hp 




TEACHERSmV+fc i 
CODER : 










OBSERVED 
§ STUDENTS Beg, ^ 






t 


DISTRICT fi HJ_ 


TEACHER # _ 


CODER # 


PRESENT <ZO Mid. 

End 




True 
Tint 


1 






4 


5 


_6 


7 


a 


q 












la: 












ASSIGNED 




















E ARTS 


WJAbt>itNJ/ 
TRANSITION 




















crtn ai I7IMT 
5QUALIZINb 












































iirfifTI to i m / 

JWuUiriLU/ 
OBSERVING 




















READ 


JUT Or ROCn 






















rrtTit 

lOTAL 
JMEK6AGED 






















JJGAGED 






















ASSIGNED 




AO 


ao 


ao 








! 




WMAGQSENT/ 

TDiiie 1 Tl rt*it 

TRANSITION 


o- \ 








o-l 












SOCIALIZING 




















1 


31SCIPLINE 




















JfJCCCUPlED/ 
OBSERVING 




1- 3 


o-a 














I 


CUT OF RCCM 






















TOTAL 
JMEMGAGED 


o-s 


1-3 


















ENGAGED 










/3-ao 












OTHER 
ASSIGNED 






















PULL CUT 
ASSIGNED 






















IX). OF 
5TU3ENTS 

P3ESENT 





















1.99 



114 



lT34h 



4/14/80 



Key for 1V33 
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Etl* Videotapes of Three Classrooms 

The following pages Include answer keys for videotape segments of 
three classrooms. These keys provide the correct categorization for each 
student for each observation. 

Each answer key includes the number of students present; a diagram 
showing the order of coding, location, and classification of each student; 
and the reasons for classification of all unengaged students. Students 
out of the room are also Indicated. The location of each student Is shown 
by a number and a letter; the number Indicates the sequence In which students 
are coded, while the letter(s) Indicates the behavior category. For ex- 
ample, on observation #1 for classroom A, student 1U Is the first student 
coded; he Is located In the desk nearest the camera In the first row and 
Is coded as unoccupied/observing, since he Is looking out the window. The 
behavior codes are as follows: 

E — Engaged 

M — Management/Transition 
S — Socializing 
D — Discipline 
U — Unoccupied/Observing 
ko — Assigned Other 

The specific behavior of each unengaged student is described for each ob- 
servation. Where the categorization of a student may vary, this is 
indicated by a slash. Thus, student 7E/U is the seventh student coded, 
and he/she may be coded as either engaged or unoccupied/ observing. This 
may happen if the student changes behaviors durinfc the time an observation 
csn be made. 

Two symbols are used on the pictures to help observers: 

pxCI Empty desk 

* Student has already been coded but 
has moved; do not code again (e.g., 
*8 « this was the eighth student 
coded; although he/she appears on screen 
again, skip him/her) 

Note: Adding the minimums or maximums for the individual unengaged categories 
in an observation does not always yield the minimum or maximum for the 
total number of unengaged students, since some students may be coded in 
one of two or three unengaged categories (e*g,, M/U) . 

Three dots (...) in the teacher comments Indicate either a student 
response or comments made by the teacher and students between scans 
of the classroom. 
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TEACHER COMMENTS FOR lV32a 



"Put your name on all pages... Now, I don't have to explain this, 
because you have-- 1 ' 

Observation 91 

"You know that we have been doing the-ah-punctuation. We did 
punctuation activity 1 with these skills. Three general rules follow 
for comma rules and for the use of the comma. Now, if you look in 
#1, after the salutation of a friendly letter. The salutation is 
sometimes also called the? . . . Greeting. That's rule one. Rule 
two: to separate words in a series. Excuse me, some of you aren't 
paying attention. ...You can't pay attention and watch that, too. 
Number three: to separate month and year, to separate names of city 
and state, to set off yes and no, to separate a quotation from the 
rest of the sentence. You have apostrophe rules; you have two of 
them. I want you to read silently, "What to Do." You'll put the 
number of the rule next to the example below. Look at your eight, 
nine, rules. Look at them carefully. Look at your nine "What to Do." 
All right, what is the first thing over there? Under "What to Do. 11 
What is the first thing you see? Virjann? ... All right, all right, 
Oakland, California. Look at your nine rules. Which rule would? 
Christine? ... Very good, 04. All right, read the next one. Raymond?' 1 ... 

Observation #2 

"Which rule would that be? ... Yvette? ... Separate a month and year? 
... Tina? ... To set off certain phrases in sentences? It's not 
setting off a phrase. Look at, look at them carefully. What do you 
think it is, Bill? ... You don't have a yes or a no in that sentence. 
You're guessing, you're guessing. Now what do you think, Sid? ... 
Six, because the quotation is what? What is the word quote, the quote 
there? What is quoted there? ... Stop. That's a quotation. All right, 
read the next phrase. All right, Simon. ... All right, look at your 
rules carefully. You have nine of them. Look at them carefully and 
see why the comma or apostrophe, whatever is in that sentence. Terrance? 
... Is that a? Where, where is the comma in that? Is there a comma in 
that? ... What is in that? Laurie? ... It's a contraction. That is an 
apostrophe and not a comma. See that? Ok, it's number what? ... 08. 
All right, read the next one, James. ... Read it, read it first. ... 
You weren't paying attention. ... All right, what is in there? A comma 
or an apostrophe?' 1 ... 
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K. I. — Continued 

TEACHER COMMENTS FOR IV 3 2a — CONTINUED 

Observation 03 

11 A what? ... All right, what rule is followed? ... What rule is 
followed? ... What? Michael. One? That's what you use with a 
letter. That's after the greeting of a friendly letter* Next one* 
read it for us please, Dennis? All right, what is used in that? 
Joanne? All right, what is the rule? The rule is what? ... 
Separating the month and year* Very good, Beth* »•» And what is the 
rule? ... Nine, possession. What is it that belongs to Bill? A 
book. All right, next one, Mark M, What rule? .*. 1 didn't hear 
you. ... To separate the names of city and state? All right, what 
should it? Or what do you think it is, Richard? All right, Lee? 
. ** Two, very good* It's a list* We have three different things 
there* All right, now read the next, Vanetta. Number what? 
Five, that's right, to set off yes and no* And the last one? 
Jeannette? Very good* 11 

Observation M 

"The certain phrase, after walking four hours. Now the punctuation is 
missing in the bottom* To do this very, very quickly, 01, You have 
2 sentences in each box. Read each one silently* 1*11 give you a 
second or two to read #1, box one* Find out which one needs a correction 
or whatever for the rule. .*. Read the two sentences for me, Paul. ..* 
All right, now which one, which part of what do you think is needed? 
Richard? Number what? ... You need a comma after what word? After 
what? No. Joe B., #3. All right, look at box 2* Read the sentences 
in box 2 for us, Greg. ... The what? All right, what, which one? 
Which number? Think about your nine rules that we've been studying. All 
right, Christine, do you want help? ... Christine, all right, you need a 
comma where? Right, to separate the city and state. Read box, all 
right, 3. Tonio? Think about it. Say that again. All right, 
Bill, three. 11 

Observation ffS 

"All right, very good. You should have a comma between? ... Very good. 
Four, urn, what? Heavens! Bernadine, would you read this for us, please? 
Box four. ... Now, where do you think you need something there? *•* #1* 
very good, you need it where? Right, after "Dear Mary. 11 Box 5, All 
right, Lee. ... All right. Ok, #2. What's wrong with 2? ... Look at 
"can f t. M ... It's not a comma, it's ah? Apostrophe. Ok, good. All 
right, 6, ... Ah, Nathaniel, would you read 6? ... Very good. All right, 
box 7." 
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ANSWER KEY FOR lV32o 
Observation //I— 28 fltudencs 



7M 6M 3M/S 2M/S 













8M 5M AM IM 














I2E/U 11E/U 10M 9M 















15U/M/E 1AM 13U/M/E 



t ■UCXOOaJQ 1 



IM, AM, 5M t 6M, 

7M t 8M t 9M, 1QM — Writing names on several sheets of paper 

2M/S, 3M/S — Writing name on several sheets of paper or hitting each other 

11E/U — Looking at paper or looking around 

12U/E — Looking around or looking at paper 

13U/M/E — Looking at camera, putting name on papers, or looking at paper 
1AM — Putting name on papers 

15 U/M/E — Looking at camera, putting name on paper, or looking at paper 
16U/E — Looking around or looking at the teacher 
17U — Looking at camera 

20U/E"Looking at camera or responding appropriately 
21E/U — Looking at paper or looking at camera 

22E/D, 23E/D, 25E/D, 27E/D — Listening to student being disciplined 

or looking at paper 

2 AD — Being disciplined 

26D/E, 28D/E — Listening to student being disciplined or looking at paper 
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20E 



23 
U/E 



24E 



26E 



28E 



TIACHEft'l 
DISK 



17E 16E 







19E 18E 






22E 21E 






27E 25E 




1 
1 



ANSWER KEY FOR lV32a 
Observation #2 — 28 students 



7E 



6E 



3E 2E 













8E 5E 4E 1E/U 














9E 10E HE 12E 














15E 


14E/U 


13E 





1E/U — Looking at paper 

or looking at camera 
7E — Can't see so assume 

he is engaged 
14E/U — Looking at paper 
or looking across 
room 

23U/E — Looking across room 
or looking at teacher 




9 

ERJC 



-wnr 0t« 




20E 

23 
E/U 

24E 

26 
U/E 



28E 



Observation #3 — 28 students 



TF>C*ft*'S 
0ESK 







19E 18E 






22E 21E/U 






27E 25E/U 







»txrtt dcsi 













8E 5E 4E 1U/E 














9E 10E HE 12E 















14E/IT 13E 
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123 



1U/E — Looking at camera or 
looking at paper 

2U/E — Playing with pencil 
or looking at paper 

3E/U — Looking at paper 
or looking around 

14E/U— Looking at paper 
or looking around 

16E/U, 

21E/U, 25E/U— Looking at 
paper or looking around 
23E/U— Scratching or 

listening to 

teacher 
26U/E — Looking around or 

listening to 

teacher 
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E»l. — Continued 



20E 
23E 

24 E 
27E 



28 
U/E 



ICACHU't 



17E 16E 







19E/U 18E 






22E 21E 






26E 25E 







ANSWER KEY FOR lV32a 
Observation #4 — 28 students 



7E 6E 



3E 2E 














8E 5E/U 4E 1U/E 














9M 10M/E HE 12E 














15E 


14E 


13E 





1U/E — Looking at camera 
or looking at paper 
5E/U — Looking at paper 

or looking around room 
9M— Listening to teacher's 
nonacademic directions 
10M/E— Listening to 

teacher * a non- 
academic directions 
or reading 
19E/U — Looking at teacher/ 
paper or looking 
at camera 
23E-- Assume student is 

engaged 
28U/E — Looking around 

room or looking at 
paper 



tam desk 



17E 16U/E 



I «LACKD0*IU> | 

Observation #5 — 28 students 
7E 6E 3E 2E 



20E 
23E 

24E 
27E 

28 
U/E 







19U/E 18E 






22E 21E 






26E 25E/U 


















8E 5E 4E 1U/E 














9U 10U 11E 12E 














15E 


14U/E 


13E 





lU/E™Looking at camera 
or looking at paper 
9U™ Looking at camera 
10U — Looking at student #9 
14U/E — Looking around room 

or looking at paper 
16U/E— Looking around room 

or looking at paper 
19U/E — Looking at camera 
or looking at paper 
25E/U — Looking at paper or 

looking around 
28U/E — Looking around or 
looking at paper 
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r 6E/U 
15U/E 
14E 



ANSWER KEY FOR lV32b 
Observation #1 — 16 students 





13E 
12E 
HE 
10E 











































9E 
8E 

7E/U 
6E 




5E 

4U/S/E 

3E/S 

2E 



1M 



1M — Walking to book 
nook 

3E/S— Talking to 

neighbor 
4U/S/E — Looking at student's 
paper (#3) > talking 
to neighbor (//3)> or 
looking at own paper 
7E/U — Looks up from work 
15U/E — Looking at student 

(not seen) 
16E/U — Yawning and looking 
around 



Book Nook 



Teacher's 
Desk 




Observation #2—16 students 




Book Nook 




16M 



8U 

7E 
6U 




5E 



4E 



3M/E 



2M 



1? 



Teacher's 
Desk 



2M— Waiting for 

teacher's help 
3M/E — Getting materials 
out of box or 
working 
6U~Looking at student 

in corner 
8U— Looking around 
and at teacher 
9U — Looking at 

student in corner 
11U — Looking at 

student in corner 
12E/M — Turning pages 

in book 
16M — Walking to teacher's 
desk after being 
called from corner 
for making noise 





— Empty Desk 
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* — Already counted; do not code 
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16E 
15U/E 



*1 

Book Nook 



ANSWER KEY FOR lV32b 
Observation #3 — lb student s 



11M 











— 




13D 










12E 









10E 

9D/U 
8D 




7E 



6E/M 



5E 



ID 



4D/M 
3D/M 



2D 



Teacher's 
Desk 



ID—Being disciplined by teacher for making too much noise 
2D — Watching student being disciplined 

3D/M t 4D/M — Watching student being disciplined or waiting for teacher 
help 

6E/M— Pickinfc up pencil 

8D — Watching student being disciplined 

9D/U — Watching student being disciplined or looking around 
11M — Walking to teacher's desk 
13D~Watching student being disciplined 
15U/E — Looking at other student's paper (#16) 



— Empty Desk * — Already counted; 

1,111 do not code 
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ANSWER KEY FOR lV32b 
Observation #4 — 16 students 




15U 
14E 





12E 










HE 






*1 




10U 










13M/U 





























9E 

8E 
7E 




6E 



5E 



4E/U 
3E/M 



2M 



IE 



16E/U/S 
Book Nook 



Teacher *s 
Desk 



2M — Waiting for teacher's 
help 

3E/M — Measuring or getting 
materials out of box 

4E/U — Writing or wiping 
face 

10U — Looking at teacher 

helping students 
13M/U— Sitting down at 
desk or looking 
around 
15U — Looking at teacher 
16E/U/S — Looking around, 
looking at game* 
or socializing 



Observation #5 — 16 students 




LM/E — Sitting down; 

getting ready for 

new activity 
6E/U — Looks around briefly 
12E/U — Looking around 
14U/E — Looking at camera 
15U—Staring 



16E 

Book tiook 



Teacher' s 
Desk 




— Empty Desk 
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TEACHER COMMENTS FOR lV32c 



Observation ifl 

"Take your seats. I will tell you the directions in just a second. 
Do you remember yesterday — Mark, your book should be doing what? It 
should be closed. Thank you, ok, do you remember yesterday we were 
practicing some takeaway problems at the board? ... Ok, this afternoon... 
Tammy. . .Amanda. . .Melissa. . . Listen to all the people we have to wait for. 
We've been doing an awful lot of waiting today... Shh, Eugene... 0k f 
remember yesterday we were doing some takeaway problems. I'd like to 
start out today by doing a few at the board and I T d like to have some 
people come up and help me find answers. When I see someone sitting 
especially nice, then I T 11 know that you are ready for a turn to come 
up and do a problem. ... I can tell there are a lot of people that aren't 
going to be ready to come up to the board. ... Ok, maybe Amy can come up 
and pick a problem and see if she can find the answer to it. Jennifer 
can also come up and find a problem. .. (PA announcement) and I think that 
...Jason can go up and find a problem. . .and Lisette may find a problem 
and Tammy may find a problem... The rest of us should be looking at the 
board. Let T s watch and see if we can find the right answer going up on 
the board. Let's see. . .Jeff .. . What T s up, Tammy? ...Shh, let T s see if 
we can find the right answers. You should be thinking to yourself like 
I see Mark thinking and watching and I see Nancy thinking and watching. 
See if you can get these problems answered correctly... Ok, very good, 
Jason, that's fine. .., That's ok. 1 ' 

Observation #2 

"Ok, Eugene, let's take a look at this first problem while we're waiting 
for the rest of the answers. ... Would you please read it for us? ... 
Bow would you read this if you looked at it? ... Sorry, I'm sorry, but 

1 don't appreciate calling out. Eugene... Thank you. Jason, sorry I 
had trouble hearing it because you were talking. You may sit down... 
Ok, Eugene, is this the right answer. . .No. . .Eugene. . .Lisa, I'm talking 
to Eugene. Thank you. Eugene, would you please tell us what you think 

5 takeaway 2 equals ... 7. . .Nancy said, "No. 11 Nancy, do you know... Excuse 
me, Tammy, Nancy, do you know what Eugene is doing when he said, "5 takeaway 

2 equals 7. ..He thinks it's plus. Remember, Eugene, this sign means that 
we start out with five things. .. circles , ok, Eugene. Let's start out with 
five... then it tells us to takeaway 2. Ok, you want to come up and take- 
away 2? Erase 2 of those circles, so we don't have them anymore. ... 

Ok, Eugene, how many circles are left? ... 3. So 5 takeaway 2 does c^ual 
3, doesn't it? ... Ok, very good, ok, let's take a look at this next 
problem. How would you read this problem? Antonio. . .Shh. . . Is that 
right? ... Ok, there's too much noise. Somebody says, "No." ... Ok, would 
you please sit down, ok, let's stop a minute. .. let 's stop a minute and 
think about it. Pencils should be down, Eugene... Pencils should be down 
...Eugene, no, it's still not down, is it? No, it isn f t. . .hands on the 
desk... Thank you. ..on the desk... 0k t Jason and a couple of people said 
that" 



9 

:RLC 
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E.l — Continued 



TEACHER COMMENTS FOR lV32c—CONTINUED 



Observation #3 

"it should be 2. ... Let's watch, ok, this time we'll have four boxes. 
Ok, I need Tanya... to come up and take away 3. ... Erase 3 of them... 
Jason. ... Ok, how many are left? ... 1. 4 takeaway 3 equals what... 
1, ok. Thank you, Jason. ... Ok. ..Mark. .. Why Is this answer 3... 
Ok, sit down, ok... When you take away 0, you f re not taking anything 
away. So 3 takeaway 0 Is 3. ... Ok, let's see If pictures can help us. 
Ok, this time we f ll try triangles. Here's 3 of them and It says don't 
takeaway anything. ... So let me put the eraser down, shouldn't I... 
equals... Ok, If I put my eraser down and I don't use it how many are 
left? ... 3 takeaway 3 equals 3 takeaway 0 equals 3. Ok, how about 
the next one? ... Do you know what the next one was? ... And the last 
one. ..the last one. ..ok, we have some people saying, "Yes. 11 . . .and some 
people saying, "no. 11 ... Ok, Instead of calling out, let's watch again. 
Mark, let T s look up here. Ivory. ..I need your help. ... Come up here 
and help me; you f re going to have to help me. We're going to start out 
with 2 boys, ok... And our problem tells us... That looks like it's a 
girl. ... We f ll pretend it's a boy... Ok..." 

Observation M 

''We're going to do what the problem tells us. Ivory Is going to do It. 
We're starting out with 2 boys... Then It says we're going to take them 
away. They're going out and play... They don't want to be In here, so 
let's take both of them away, Ivory... How many are left? ... Nothing, 
zero, ok, we have a little too much help up here. I don't think we 
quite need It. Thank you very much, Ivory, ok. Would you believe, 
please, now, let's see If we can do the same kind of problem by ourselves 
and let's turn to page 90... Page 90. You'll find on page 90 that we're 
going to have to. . .be very careful. ... The book Is going to try to trick 
you. It's going to have some plus problems and some takeaway problems. 
... By yourself, very quietly, I'd like you to see If you can do that 
page. I don't want anyone looking at anyone else's paper. ... Very good, 
Mark got started right away. Richard, let's turn around. ... Ok... 
excuse me, Antonio... 0k, would Mrs. Mettles' group please — no, not 
Mrs. Mettles' group just Ted... No, In your seat and get busy...' 1 

Observation #5 

"Sit down. .. Ok, Jason get busy... Lisa, have you started?... Amy's 
doing a very nice job...' 1 
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ANSWER KEY FOR lV32c 
Observation #1 — 27 students 



j_._JHl^ j 

AU/M 3U 2E IE 



W 7E 7>M 5M 

12M 11M 10M 9M 



I 



a 

H 



16M 15M 13M 
1AM 




22M 23M 2 AM 
25M 



__ _ 25M 26M Z7.iL- 



H 




3U — Looking into space 
4U/M — Looking across room or 

listening to teacher 
5M, 6M— Waiting for teacher 
8U — Looking around 
9M, 10M, 11M Listening to 
12M, 13M, 15M, — teacher's nonacademic 
16M directions 
14M — Returning to seat 
17M — Walking to board 
18M, 19M, 20M— Listening to teacher's 

nonacademic di rec t ions 
21M — Walking to board 
22M, 23M, 2AM— Listening to teacher's 

nonacademic directions 
251*-- Listening to teacher's non- 
academic directions 
26M — Listening to teacher's 

nonacademic directions 



WINDOWS 



Observation #2 — 27 students 






3U 

— 




, 







8D/U 7D 



6D 



I 

. "J 
5M 



1XV^,..±QP. ?D _. 

r~ 



16E/M 15E 1AE 13E/M 

17E 1£E_ 19E/U 

::::r::: 

20E 21E 23E 2AE 



22E 




25E 26E 27M/E 

L7:::e^:::i;::x:: 



— Empty Desk 



* — Already counted; do not code 



-RIC 



130 







to 
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1U/E, 2E/U — Looking around or looking 

at paper 
3U — Looking at neighbor 
5M — Playing in desk 
6D, 7D — Listening to teacher 
discipline a student 
8D/U — Listening to teacher discipline 

or looking around 
9D, 10D, 11D— Listening to teacher 
discipline a student 
12D/E--Listening to teacher 

discipline a student or 

looking at teacher 
13E/M — Looking at teacher or 

listening to directions 
16E/M — Looking at teacher or 

looking in desk 
19E/U — Looking a t teacher or 

looking across room 
27M/E — Flipping pages in book or 

looking at teacher 
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ANSWER KEY FOR lV3?c 
Observation #3 — 27 students 




BOOKf, 



1 



AK/L' 



13E/M 




8E 

-12B- 



7U 



6E 
10E 



5U 



9E 



14 E 
18E 



15E7u~ "l6E7u" 
19E/U 20E 



17E 



21U/E 
22E 



J3 



23E 



25E 



24E 
26E 



27U 



izz:is<x::iz:izrj 









QJ 






.-r 


















H 

















3E/U j 4E/U — Looking at teacher or 

looking around 
5U — Playing with book 
7U— Playing with toy 
13E/M--Doing problem on board or 

returning to seat 
15E/U, 16E/U— Looking a t teacher 

or looking around 
19E/U — Looking at board or looking 

around 

21U/E— Looking at camera or 

looking at board 
27U — Playing with ruler 





4E 



7E 

12M HE 



16M 
17M 



L J*™*-? J Observation M--27 students 

3U/E 2E IE 




J 




ERIC 



_10E_ 

Tsm"* 

18M 



6E 
9E 



5E 



_.J 



8E 



13M 



Y4H 
19M 



20M 
22U 



21M 



23M 
25M/E 



3U/E~Looking around or looking 

at board 
12M — Waiting to return to seat 
13M — Walking to bathroom 
1W4 , 15M, 16M, Listening to 
17M, 18M, 19M, — teacher T s nonacademic 
20M, 21M directions 
22U — Looking out window 
23M — Listening to teacher's 
nonacademic directions 
24M/E — Listening to nonacademic 

directions or looking at book 
25M/E, 26M/E~Listening to 
v nonacademic directions 

TliMoI or looking at book 

27M/U — Listening to nonacademic 

directions or looking around 



Si 



... \ 



26M/ 

1 

J 



! 27M/U 



[^X^l — Empty Desk 



* — Already counted; do not code 
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ANSWER KEY FOR lV32c 
Observation #5 — 27 students 
(1 pullout; 1 student out of room) 



BOOKS 



2U 




WE 13E 12U 
17U 16U 15U/M 



- 



J. 



ISO 



__.L 

"18E 19E7lT , "21U/E*^r2E' 
20E 23M/S 24S/E 25S/M 




•d to 

o 
H 



WINDOWS 





1U/E — Looking around or looking in book 
2U ( 3U ( 5U--Looking around 
AM — Turning pages in book 
6U/E— Looking around or looking in 
book 

7S — Talking to neighbor 
8U — Looking around 
10E/S--Looking at book or talking 

to neighbor 
12U--Looking around 
15U/M — Looking around or 

listening to teacher's 

nonacademic directions 
16U — Looking at neighbor 
17U — Looking around 
19E/U — Looking in book or looking 

at neighbor 
21U/E — Looking around or looking 

in book 

23M/S-- Moving papers around or 

talking to neighbor 
24S/E — Talking to neighbor or 

looking in book 
25S/H — Talking to neighbor or 

turning pages in book 




--Empty Desk 
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E t 2 t Independent Practice Videotape 



The following pages Include an answer key for the videotape 1V33, 
Thla key provldea the correct categorization for each student for each 
observation* 




The answer key Includes the number of atudents preaent; a diagram 
showing the order of coding, location, and classification of each atu- 
dent; and the reasons for clasaif ication of all unengaged studenta. 
Students out of the room are also indicated* The location of each atudent 
Is ahown by a number and a letter; the number indicates the aequence In 
which studenta are coded, while the letter(s) Jtndicatea the behavior category, 
For example, on obaervation #1 atudent 8S la the eighth student coded; he la 
located by the deak neareat the camera in the first row and la coded aa 
aocializing, since he la talking to another student* The behavior codes 
are aa followa: 

E — Engaged 

M — Management/Tranaltlon 
S — Socializing 
D — Discipline 
U — Unoccupled/Obaervlng 
Ao — Asalgned Other 

The apeclfic behavior of each unengaged atudent la described for each ob- 
aervation* Where the categorization of a atudent may vary, this Is 
indicated by a alaah. Thua, atudent 7E/U Is the aeventh coded, and he/she 
may be coded aa either engaged or unoccupied/observing* Thla may happen 
If the student changes behaviors during the time an observation can be made. 

Two symbola are used on the pictures to help observers; 

Empty deak 

Student haa already been coded but has moved; do not 
code again (e.g*, *8 — this was the eighth student 
coded; although he/she appears on screen again, 
skip him/her) 



Note; Adding the minimum a or maximums for the Individual unengaged categories 
In an observation does not always yield the minimum or maximum for the 
total number of unengaged students, since some students may be coded In 
one of two or three unengaged categories (e.g., M/U). 

Three dots (*.*) In the teacher comments Indicate either a student 
response or comments made by the teacher and students between scans of 
the classroom. 
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E.2. — Continued 



TEACHER COMMENTS FOR IV'J'J 




Observation til 

"All right, we counted by Is, didn't we? That's the way we've been counting all year, 
one right after the other, one right next to the other. And we used our number line 
before, we went by la, didn't we? Well, today we're going to learn how to count by 
2s, and if we have time, we're going to learn how to count by 5s. Is that faster than 
counting by Is? ... It's a lot faster. All right. Kevin is going to walk for us 
here. He's going to start at 0, and he's going to take a step that gets him all the 
way over to 2. Can you get to 2? Ok. That's 2. 1, 2. He took 2 steps. Everybody 
put out 2 beans. Shaun, will you put 2 blocks here so everybody can see them? Ok. 
You should have 2 beans out like his 2 blocks, and will you circle the 2? He started 
here. Let's circle the 2, the first 2." 

Observation #2 

"He started at 0, and he went over to 2, ok, and he stopped at 2. Now, can you take 
2 more steps? Where are you going stop this time, Kenneth? ... 4. All right. So 
put another set of 2, everybody, 4. How about 2 more steps? Now where are you? ... 
6. Ok, 2 more. ... Up to 8. Do you have your sets of 8 out? You should have 2,4, 
6,8. Ok. Keep them in sets of 2, keep them in sets of 2. Let's keep them so they're 
in sets of 2. All right. Just like Shaun's doing. See how he has his in sets? Oh, 
you ca;i't see them. I'm going to have to change those. So you can see them in sets 
of 2. You have the right number, dear, but let's fix them so that you see them in 
sets of 2. Ok? ... No, you should have 8. Let*s get 2 more. Everybody have 8 now?' 1 . 

Observation #3 

"All right, Kenneth, how about 2 more sets? Now where are you? ... 10. All right, 
everybody put out 2 more. Now, 2 more sets. ... 12. Well, all right. Now, Jason, 
you can put the crayon down for a minute. How many do we have here all together, 
Shaun? ... 12. Instead of counting by Is, let's count by 2s this time. Start with 
0. Point to your set of 2 if you want to. ... What are we going to have next? 2, 
... 12. We counted by 2s. Now point to your sets of beans. Jason, you point to 
our set up here. Help me to count, ok? Everybody, are you pointing to your set of 
blocks?" 

Observation M 

"You point to each set of 2. Now how about coming back here and as they count in 

2s, you are going to walk in 2s. All right, ready, 2, A, 6, 8, 10,12. I didn't say 

put them all out again, just leave them out like they were, and point to the sets 

of 2 as we count them. We* re going to have to do it again. Everybody have their sets 

of 2s out? ... 0k, let's leave them like you had them before, David. Ready, go. 2, ... 

Wait a minute, wait a minute, Kenny's not ready. Come back and jump for us a:;ain." 

Observation #5 

"All right, ready. 2,4,6. Are you counting along? 12. All right, you want to 
try it a£ain? Kenny? And everybody, let's watch him and let*s go and point to : our 
own sets of 2. You ready, Kenny? 2, A ,6,8 ,10,12. ... Woop, we're going to have to 
keep doing it here, everybody's nut doing it yet. Get your 2s out and potnL. May- 
be this time it will be more fun if you put your fingers on the two of them. Put 
your 2 fingers on them like this. Co on that way. Some of you have been doing it 
all along. 0k? 11 
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E> 2. --Continued 

TEACHER COMMENTS FOR 1V33--CONTINUED 

Observation H 

"Maybe It will be more appropriate If you will put your two fingers oti 
them like this, like you have been doing It all along* Let's try It 
again. Ready - 2, 4, 6, 8, 10, 12. Does anybody know what would come 
next? ... We're counting by 2s. ... No, that would be counting by Is; 
It's one higher. Kenny? ... 14? ... All right. You want to jump to 14 
for us? What's going to come after 14 If we're counting by 2s? Maryanna 
... 16. All right, who can guess what's going to come next? Judy... 
18. What will come next, Richard?" ... 

Observation #7 

"No, that's counting by Is again. 20. All right. Does anybody think 
they know what's golftg to come after 20? What's It, Richard? 22. 
What's going to come after that? Jeff ... 24. Mike, do you know what's 
going to be next? ... 26. What's going to be next? ... What's going to 
be next? ... 28, what's next? ... No, that's by Is again. No, 30. ... 
What's going to come after 30? ... No, that's by Is again." ... 

Observation #8 

"32. . . 34 , . . No, that's by Is again. .. 36. . . No, that's by Is. 38, ok. 
What comes after 38? ... 40. All right, let's all start with zero and 
go all the way up, Count with us here even though you're only counting 
to 16. Ready. All right, you can go counting up to 12, Shawn, you'll 
point to 12. Ready, 0, 2. Everybody start with zero. 0, 2, 4, 6, 8, 
... Uh, uh, uh, 10." ... 

Obse rva tion #9 

"12, 14, 16, keep going, 18, 20, All right, very good. You people may 
go back to your seats. Let's look at the page where at the top you'll 
sec the Indian feaLher. It says "How Many?" How many? On the first 
Indian band, how many feathers, David? ... So write your 2 underneath* 
See if you can fill in all the Indian feathers counting by 2s." 
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ANSWER KfiY FOR 1V33 
ObHorvntion 01 — 20 students 



K.2. — Continued 



Blackboard 



HE 




20E 



-112E 
I 






|13R| 


r 




HE 




15E 




16E 




17E 








19E 


i 




9E 
8E 

7U/E 
6U/E 

5E 



— 

X 



4E/M 
3E 

2E/U 
1U/E 



1U/E — Looking out windows 

2E/U — Looking around 

4E/M — Looking at papers or 

putting awny materials 
6U/E-- Looking at student (#7) 
7U/E — Looking at camera or 

at blackboard 



Observation #2 — 20 students 



Bl ^rkbcnrd ^ 
HE 




1U — Looking out windows 
4U/E— Looking at camera 

or at blackboard 
18E/U — Looking at blackboard or 
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ANSWER KEY FOR 1V33 
2/1/80 Observation #3—20 students 



E . 2 . — Cont inued 




1U/E — Looking at camera 
6U/E — Looking at camera or doing 
work or looking at teacher 




Observation #4 — 20 students 



Blackboard 



1 IE 

Line 
L2E 10E 



18U : | 14E/U 

: 16E/U 



20E/U ! 



I 



I13E 



15E 



17E 




19E 



O 



9E 
8E 

7E 
6E 

5U 




Teacher is providing corrective 
feedback to students. 

2E/U —Looks up briefly 
5U t 18U— Looking at camera 
14E/U — Looks at camera 
16E/U — Looking at teacher 

or looking around 
20E/U — Doesn't have beans out 
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ANSWER KEY FOR 1V33 
Observation #5 — 20 students 



V., 2, — Continued 



Blackboard 



HE 

4 Line 
-l 12E 10E 



Teacher's 
Desk 




O 




9E 
8E 
7U/E 
6M/E 



5E 



4E 

3E 
2E 

1U 




Teacher is giving corrective 
feedback* 

1U, 20U — Looking at camera 

6M/E — Picked up something from 

floor t then paying 

attention 
7U/E — Looking out window; then 

looking at board 
15E/U — Looking around 
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E.2. — Continued 



ANSWER KEY FOR 1V33 
Observation #6 — 20 students 




1U/E — Looking at camera or 

looking at teacher 
3E/U — Looking at beans or 

looking around 
5S/U — Talking to neighbor 

or looking around 
18U/E — Looking at camera 
or looking at 
teacher 
20E/U — Looking at teacher 

or looking at camera 




Observation #7 — 20 students 



Blackboard 



leather' 
Desk 


s 


18E 








<s" — 










20E 








X 






iRIC 




14E 
15E 
16E 
17E 

19E 



*- Ec.pty desk 




9E 
8E 
7E 
6E 

5E/U 



4U/E 

3U/E 
2U/E 

IE 
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2U/E — Looking at camera or 

looking at teacher 
3U/E, 4U/E— Looking around 
or looking at 
teacher 
5E/U — Looking at teacher 
or playing with 
pencil 

13E/U — Looking at teacher 
or looking around 



139 



* — Already counted; do not codi 
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K , 2. — Coin imic;d 



Blackboard 



ANSWER KEY FOR 1V33 
Observation #8 — 20 students 
(1 student out of room) 



11E/M 



Teacher's 
Desk 



/ Line 

12E/M 



18M/E 




10 

E/M 



O 




9U/E 
8E 
7U/E 
6U/E 

5E 



4E/U 

3E 
2E 

IE 



4K/U — Look tug :it tonchor 

or looking at camcrn 
6U/K t 7U/E, 9U/E~Looking 
at camera or looking 
at teacher 
12E/M — Listening to teacher 
or getting ready for 
next activity 
13M/E, 14M/E, Waiting for 
16M/E, 17M/E,— teacher or 

listening to 
teacher 



18M/E, 



15M/U/E— Waiting for teacher, 
looking at camera, 
or listening to 
teacher 



Observation #9 — 20 students 



Blackboard 



Teacher's 
Desk 



16E 



18 

E/U 



20E 



El 




# Lli 



12 
E/U 

13E 

UE 

15E 

17E 



19E 



3 



o 



he 

10E 

9E 

6U 

5U 



7M 
8M 
4E 

3E 
2E 

IE 



5U — Playing with toy 
6U — Looking at camera 
7M, 8M — Returning to seats 
12E/U — Looking at page or 

looking around 
18E/U — Looking at teacher 

or putting on shoes 
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©F. Demonstration of mastery of the Engagement Rate Form (60-120 minutes) 



Rationale . Observers need to be certain that they can collect data 
accurately using the Engagement Rate Form. Leaders need to certify 
mastery before Information collection proceeds. 



Materials 

/1H35--Engagement 
(a-g) Rate Form 
1 V36 — Demons t rat Ion 
(a-c) of Mastery on 
the Engagement 
Rate Form 
1T37 — Answer Key 
(a-f) for /1H35 
—Engagement 
Rate Forms (3) 



Strateg y 

Review the directions sheet (/lH35a) 
and decide which tapes will be viewed. 
Observers must either demonstrate 
mastery or "almost" demonstrate mastery 
on lV36c before collecting data In 
classrooms. Most groups will probably 
want to begin with lV36a or lV36b and 
then go on to lV36c. If you believe 
that your group needs additional 
practice or an opportunity for a 
successful experience, however, view 
both lV36a and lV36b. If the group 
did very well on the last tape (1V33), 
you may wish to begin with lV36c. 
Before viewing the videotape for each 
classroom, be sure to read the 
PreHDbservatlon Form and the "Hints for 
Coding" page that describe the class- 
room. After completing an Engagement 
Rate Form for the first selected class- 
room, check and discuss answers. 
Answer keys showing the correct coding 
of each student during each observation 
are Included In Note F. In order to 
demonstrate mastery, participants (1) 
must be within the Indicated range for 
the number of students engaged on at 
least 8 of the 10 observations and (2) 
must be within the Indicated range for 
the total number of students engaged. 
If some people "almost" demonstrate 
mastery (I.e., within the Indicated 
range for number engaged on at least 6 
of 10 observations and within range on 
total 0£ within the Indicated range on 
at least 8 of 10 observations and within 
15 students of the total engaged), these 
people should code lV36a or lV36b If 
they have not already done so before 
proceeding. For example, someone who 
begins with lV36c and "almost" demonstrates 
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Demonstration of mastery of the Engagement Rate Form — Continued 



Materials 



Strategy 



mastery should also code lV36a or lV36b. 
However, someone beginning with lV36b 
who "almost" demonstrates mastery would 
proceed to lV36c. Those people who do 
not demonstrate mastery may need to 
code the tape again (e.g., someone who 
demonstrates mastery on lV36a but falls 
to do so on lV36b may need to code lV36b 
again If his/her errors were due to a 
faulty understanding of the definitions). 
You may wish to have them code all or 
part of any easier tapes (A and B are of 
approximately equal difficulty and are 
easier than C) they have not seen before 
coding the tape again (e.g., someone who 
begins with lV36b and falls to 
demonstrate mastery should probably code 
lV36a and then perhaps code lV36b again 
before looking at lV36c). If partici- 
pants have seen all the easier examples 
on 1V36, you may wish to go back to the 
definitions and training tapes In 
Topic E and Appendix £ before coding 
the tape again (e.g*, someone who 
falls to demonstrate mastery on lV36a 
should probably go back to the 
definitions and training tapes). If 
participants fall to demonstrate 
mastery on two tapes In a row, they 
should return to the definitions and 
training tapes before proceeding. 



Alternative Strategies 



1. 



Have observers complete the checkpoint between meetings. Check 
completed forms at the next session. 



2. 



Not all participants may want to use the same viewing pattern. 
In this case, you may want to provide choices by using two or 
more sets of videotape equipment or by setting up small group 
meetings to view each tape separately. 



3. 



You may wish to break up the coding of videotapes by completing 
the activities in Topic G (Allocated Time Log) and/or Topic H 
Scheduling) . 
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1. Directions for checkpoint (/lH35a) 

a. Purpose — ensure accurate collection of information 

b. Viewing pattern—must demonstrate mastery on C 

(1) Most groups use B + C 

(2) If want to start with easier tape, use A + B + C or 
A + C 

(3) If want to start with more difficult tape, use C 

2. Pre-Observation Form (/lH35b . /lH35d . /lH35f ) 

3. Hints for coding f /lH35c . /lH35e. /lH35g ) 

4. Videotape r iV36 ^ 

5. Directions for Engagement Rate Form 
t6. Calculations (1 T3 7) 
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U3 



Materials 



In addition to the materials included here ( the following will 
be needed: 

Engagement Rate Forms (3) (Forms) 
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A /lH35a 
\ VST DIRECTIONS FOR DEMONSTRATING MASTERY OF THE ENGAGEMENT RATE FORM 

Since classroom observation data will be compared to data collected 
in research studies, comparisons are only valid if the observations are 
carried out in a manner similar to that used in the original study. Thus 
only trained observers should collect data that will be used in comparisons. 
Those people collecting data should complete this checkpoint to check 
whether they are coding in a manner similar to that used in the research 
stud les. 



There are samples from three classrooms on the videotape for this 
checkpoint. Individuals who are going to be doing observations in a class- 
room or who are going to train others to do observations in a classroom 
should "master" this checkpoint. Mastery can be demonstrated by coding 
sample C within an acceptable range (i.e., 8 of 10 observations within the 
indicated range and the total engaged within the range). Most observers 
will probably want to begin with sample A or sample B» although some may 
wish to begin with the more difficult sample C. Before coders attempt the 
mastery of these tapes they should already have coded 1V33 (independent 
Practice in Observation) within an acceptable range. Alternative sequences 
for viewing the tapes are listed below. 




• A B C 

• A + C 

• B + C 

• C 

Before completing an Engagement Rate Form for each classroom, read 
the description for that class on the Pre-Observation Form that follows. 
If time permits, you may also wish to preview part or all of the tape in 
order to better understand what is happening in the class. 



When completing the Engagement Rate Form, record all the identification 
information and observation times in the headings as they are indicated on 
the videotape or Pre-Observation Form. Also be sure to record data for each 
subject in the appropriate part of the form. When recording data you may 
wish to use the still-frame on a group of students so you may observe them 
longer. It may be necessary also to repeat a segment several times to be 
certain of what particular students are doing. After you complete a form 
\ I — £ or one classroom, check with your meeting 

leader to see if your engagement rate is within 
' the acceptable r£,ige. If your engagement rates 

are not within this range, the leader will 
indicate which categories of behaviors you are 
coding incorrectly. 
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/lH35b 



Pre-Observation Form for Classroom A - Grade 6 



Teacher Peter Demetrios 



Observer 



Subject Reading /Language Arts 
Observation Date m/9.0 



Time Interval 2 minutes 



No. of Students Present 16 



Circle beginning 
Part of Period ^ojid dleT 

enc 



Record number of students assigned to each category during the observation period. 



Times 



Reading/ 
Language Arts 



Math 



Other Subjects 
Specify: 



Pull- 
Out 



Out of Room 
Specify : 




10:02 



16 students 
assigned to 
reading /language 
arts 



P re-Ob servat Ion Form (cont'd) 



Briefly describe assignments for each subject and free-time activities 
(attach worksheets if possible). 

Reading/Language Arts 

At first I will be working with a mall group, while the rest of the 
class is doing seattfork* Then the small group will be working 
independently, while I work with the large group on a reading assignment. 
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10 















3 












6 






7 




/lH35c 



HINTS FOR CODING CLASSROOM A 



12 1 



1*, 



L*rg# Ttbl« 



The classroom's arrangement and the general pattern 
for coding are shown. The students next to the 
large table (#11-#16) return to their seats around 
that table after observation #2. 

The teacher makes the following comments: 

§ Observation #1 

5 The teacher Is working on academic content with 
a reading group. 

Observation #2 

"I want you to complete pages 41, 43, and 44. The 
second thing I want you to do Is to copy the new 
spelling words. Those right there. There are ten 
of them. . They are words for the next story. 
This story here. ... No, the other ones, here. Ok, the third thing I want — are you 
listening, Albert? , .. is to do some extra writing. How are we going to find time 
to do that? All right, what I want you to do now Is this. Ok. Go back. Sit 
along here. Get a pencil out and do these three dittos. As soon as you complete 
all three, staple them and put them on my desk. They are not due today. They are 
due Monday. Ok? ... As soon as you do that you move along and what do you do? 
Ron? ... Number two. Yes, and when you are all done with that you can go to your 
SRA folders. 0k f go right around here. Go this way... By Monday. .." ... 

Observation #3 

"Ok, 1*11 pass these out to you. I have two papers here. As I give them to you 
ndw the first thing I want you to do with them Is what? ... Albert, would you like 
to sit over there? There's more room. Ok. It's not gonna last... Put your name 
on It. ... Put your name on It. Turn that chair around back. Carol... All right, 
we will go over each one together real quickly. People up front there keep reading 
that story. I'll be with you in a second all right. We're going to begin from the 
very beginning/ 1 ... 

Observations /M-ff5 

The teacher is working on academic content with the larger group. 

Observation rf6 

"So what would you connect to that sentence? What number? ... Two. That happened 
next. All right, so why don't you do the other two first and then go back to this 
if you like. What will you be doing after this, Dan? If you complete these three? 
... And put It on my desk, then what? ... Ok, but take your time with the papers. 
Let's not rush through these. Ok, any questions? Come up here and I'll answer any 
questions for you. Are there names on every one? ... Ok. Ok. People up here. 
Let's turn to the beginning of the story. I think a lot of you have been reading 
it already and you have an Idea of what the story is about. What Is the name of 
the story, Dick? ... Communicatlon"Just Words. What does communicate mean? Who 
can tell me that? I'm communicating, what am I doing? ... All right, they tell you 
they what? ... They are happy. Are they saying anything to you or are they just 
smiling? Right. That's a facial, a sign, that you are happy. What's another way 
of communicating? From one to another... Talking. 1 ' ... 

Observation #7 

The teacher Is working on academic content with the larger group. 
O bservation #8 

(PA announcement) Complete that for us, Kathy. 

147. 



"All right, good, 
siren. . ." ... 



Kathy* . . Ok. . . 



ERLC 



Observations #9-#10 

The teacher is working on academic content with the larger group. 
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+ /lH35d 



Pre^Observation Form for Classroom B - Grade 3 
Teacher Rao loo Subject Math 



Observer Observation Date Matf 25 

Time Interval 1 mlnutt 
No. of Students Present 16 



Time Interval 1 mlwtit Circle (feglnnlng) 

Part of Period mtSST^^ 
end 



Record number of students assigned to each category during the observation period 



Times 


Reading/ 
Language Arts 


Math 


Other Subjects 
Specify: 


Pull- 
Out 


Out of Room 
Specify: 


11:00 




16 6tudtnt6 
0L66AJ}n&t 

math 









Pre-Observatlon Form (cont T d) 

Briefly describe assignments for each subject and free-time activities 
(attach worksheets if Possible}. - - 



M*%h - I uti££ ttanX the. period by giving the btudwtb thei/i a66ignment6 
and thw th&y void inde.pexde.ntty vootik on thorn. FiMt the. 
6tudtnt6 witt zitheA be. &init>hing theiA math mnkbook a66igyw£n£6 
Qti completing two woAJi&ht&U on two-digit multiplication* Then 
thzy wilt be. checking theiA meoAu/iemtnt boxes in the. fcont o& 
the. sworn. I|J th&ie. ant incomplete. wbnk6he.vU> in them, thttj 
wilt complete, them. Then they mil be. doing hn&e, time, activities** 
Elephant T-unesu, ?e.opte. and Snoopy games, fitash cand6 t etc* 
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HINTS FOR CODING CLASSROOM B 



The classroom's arrangement and the general 
pattern for coding are shown. 

Students standing at the teacher's desk are 
coded first, and in observations //6 and #8, 
the' second row from the right is scanned in 
reverse order. 

The teacher makes the following comments: 

Observation tfl 
"When that's done, you're each going to 
get one -of thaflfc multiplication worksheets 
that we've been working on, with the 
riddle at the top, . . . 
We're also going, to go over the two-digit 
multiplication . . . you remember . . . right, urn-hum, this type . . . all right 
right . . . all right . . . When that's finished and in my wooden box — don't 
forget your name again—you're to. go and find. your measurement box, please. 
If you finish all that you are to do in there and your worksheet is out of your 
box, then just put it on the table." 

Student: "What about Mrs. Hausel's group, we don't have a box yet?" 



1 


BLACKBOARD 




i 


»□ 






□ 


»□ 


»□ 




□ 




»□ 




□ 




»□ 


□ < 


□ 








□ 











you remember 



Observatio n^ #2 

"All right, well then, of course, that will be with you. You don't have to be 
concerned about that. Question, Doug? H 

Student: 'tan we keep the boxes?" 

". . . No, I use those every year. I'm sorry . . . All right, the next thing is 
free activity and I think you can tell me what ideas I have. Bobbie Jo . . . 
The elephants, ok, the Elepliant Timers — ^nd if you use that, will you share please? 
Now you know, if you have the box, share with someone else. Anything else you can 
think of? Greg, let's not ..." 

Student: '*Do our multiplication cards." 
Observation #3 

". . . All right, there are flashcards in the back. Very good. So I don't think we 
should have any trouble finding something to do if you're all finished. Ok, I'll 
have your papers passed out in a minute and then you can be finishing your 'fork. 
Megan, I would like you to finish this exercise . . . (indecipherable) . . . Rusty, 
would you close your workbook please because these two need to be finished first* . 

Observation #4-#9 

The teacher is working with individual students. 

O bservation #10 

"You can't put the answers in until you add them. 
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Pre-Observation Form for Classroom C - Grade 1 



Teacher Ann Smith 



Subject 



Reading 



Observer 



Time Interval 1 minute 



Observation Date APril 10 



No. of Students Present 



28 



Circle 
Fart of Period 




end 



Record number of students assigned to each category during the observation period. 



Times 


Reading/ 
Language Arts 


Math 


Other Subjects 
Specify: 


Pull- 
Out 


Out of Room 
Specify: 


11:00- 
11:00 


2? students 
assigned to 
reading at 
first. 28 
students 
assigned to 
reading when 
pullout stud- 
ent returns. 


i 


Students may 
work on 
puzzles when 
reading 
assignment 
is done. 


1 student 

until 

11:07. 


1 student will 
be leaving 
room briefly 
at 11:03, 






Pre-Observation Form (cont 1 


d) 





Briefly describe assignments for each subject and free-time activities 
(attach worksheets If possible). 

Reading 

Croup 1 — I will be meeting with this reading group to work on 
vowel sounds. 



Group 2 



Students will be working at their seats. The 
i assignment is to write a story and then draw a 
* picture to go with the story. 





Croup 3 j 



Other Students who finish their reading assignment may work on puzzles. 
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HINTS FOR CODING CLASSROOM C 



The classroom's arrangement and the general pattern for coding are shown in 
the diagram. The student at desk #23 is a pull-out until observation #8. 
In the last observation, the students at desks #4 and #28 are assigned to 
free-time activities using manipuiatlves • During several observations, 
students are getting materials from the right-hand side and/or lower left 
corner of the room. 




The teacher makes the following comments: 

Observations ffl-//7 
The teacher is working with a reading group. 

Observation #8 

"Let's turn to page 31 in our books, in this book, 31. ... Urn-hum." ... 

Observations #9-//10 
The teacher is working with a reading group. 



Note: The blackboard has nothing pertaining to the assignment written 
on it. 
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1V36 



1V36 consists of three videotape clips of three classrooms to be used 
(uith /1H35) to demonstrate mastery of the Engagement Rate Form. 
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KEY FOR 1V36 
Classroom A 



lT37a 



STATE 

DISTRICT 
SCHOOL 



TEXrftw£rM>s 
CODER _ 



ENGAGEHENT RATE FORM 
STATE ft SCHOOL # JO. DATE IQy&O 

DISTRICT $ j£2_ TEACHER # CODER # 



PARI OF 
GRADE fa aASS 

OBSERVED 

$ STUDENTS Beg. , 

PRESENT l(o Mid,j£ 
End 





TIME 


1 


7 


3 


4 


5 


6 


7 


a 


q 










)0: OS 


10: to 












ASSIGNED 






id 










tu 






MANAGEMENT/ 

TOAUCITIflM 

tKATuM \\)7i 


1 


to 








O * 1 








LU 












J+\ ft 








o-i 




DISCIPLINE 






















UNOCCUPIED/ 
jd jcRV 1 Nu 






t J 

3- t> 


1 * to 


«H 7 




— i 

o- 1 


o-i 




LU 


DUT OF ROCM 






















TOTAL 

JIXLJTVj/VJCJJ 


1 It) 






hf 

t v 




f T 


o**i 








ENGAGED 




3- /A 


(?-<? 
















ASSIGNED 
















1 




■IANAGEKENT/ 
TRANSITION 






















SOCIALIZING 




















<0 


DISCIPLINE 




















<JJ 

a 


JNCCCUPIED/ 
JBSERVING 






















;UT OF ROCM 























TOTAL 

JNENGAGED 






















ENGAGED 






















DTKER 
ASSIGNED 


* 




















pull cot 
assigned 






















NO, CF 
STUDENTS 





















1.138 



153 



6/io/ao 



iT37b 



KEY FOR lV36a 





TIME 


10 


11 

Li 


12 


13 


14 


15 




ENGAGEMENT I 
RATE 


16 












TOTAL 


>— 

a- 

OS 


ASSIGNED 


\<0 














ENGAGED 
ASSIGNED 

st-m% 

. -k 


WJAGEKEfiT/ 
TRANSITION 
















SOCIALIZING 














O-J 


DISCIPLINE 














o 


JMXXUPIED/ 

C3SEKV1NG 
. 1 


1 














OUT OF ROOM 














o 


TOTAL 
JOIGAGED 
















ENGAGED 


9-0 












— : 


1 


ASSIGNED 
















ENGAGED 


TRANSITION 
















ASSIGNED 


SOCIALIZING 
















DISCiPLINE 
















JNOCCUPltD/ 
OBSERVING 
















CUT OF ROOM 
















TOTAL 
JNENGAGEO 
















ENGAGED 


















3THER 
ASSIGNED 




















PULL CUT 
ASSIGNED 




















? STUOCiTS 
PRESENT 
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KEY FOR 1V36 
Classroom 6 



lT37c 



STATE 

DISTRICT 

SCHOOL 

TEACHER Ht 



ENGAGEMENT RATE FORM 
STATES J>J SCHOOL* _°£ DATE $/*\ GRADE 3 



PART OF 

CLASS 

OBSERVED 



CODER ! # STUDENTS Beq. ^ 
\ Dl STRICT 9 1^ TEACHER # COOER # PRESENT Ik Mid. 
i End 




TIME 




_2 




4 


5 


6 


7 


a 


9 




U:oi 










||:Ofe 


It- 01 






ASSIGNED 




















KAHAGEKENT/ 
TRANSITION 




















SOCIALIZING 






















DISCIPLINE 




















-J 


JKOCCUPIED/ 
38SERVING 




















»^ 


]UT OF ROOM 






















TOTAL 
JNENGAGED 




















ENGAGED 




















i 
1 


ASSIGNED 


\(* 


It 




lt> 




It 




It* 1 IU 


MNAGEfcENT/ 
TRANSITION 






/o-/5 


/-A 


1 


a- 3 








SOCIALIZING 




















DISCIPLINE 




















jNCCOJPIED/ 
OBSERVING . 


0-3 


o-l 


a-V 


o-l 






0-1 

■ 




A-3 


3UT OF RCCM 




















TOTAL 
JNENGAGED 




It 


H-15 


/-3 


; 




P-3 


o~3_ 


4-5 


ENGAGED 








/A/6 


/3-/£ 












CTHER 
ASSIGNED 


















— 


POLL CUT 
ASSlGfS) 




















NO. OF 

STUDENTS 

RESENT 
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KEY FOR lV36b 





TIKE 


10 * 


. n 


12 


13 


14 - 


15 


TOTAL 


ENGAGEMENT 
RATE 


I r. oi 












LiJ 

1 


ASSIGNED 
















ENGAGED ' 


WANAGEHEW 
TRANSITION 
















ASSIGNED 


SOCIALIZING 






- 










DISCIPLINE 
















UNOCCUPIED/ 
OBSERVING 
















OUT OF ROOM 
















TOTAL 
UNENGAGED 
















ENGAGED 
















MATHEMATICS 


ASSIGNED 












• 




ENGAGED 


WIAGEKENT/ 
TRANSITION 


1 




- 


- 






15- U 


ASSIGNED 


SOCIALIZING 
















DISCIPLINE 
















UNOCCUPIED/ 
OBSERVING 


o-l 












5-« 


CUT OF ROOM 
















TOTAL 

JNENGAGED 














57- 70 


ENGAGED 






. 












3THER 
ASSIGNED 














* 




UL GUT 
ASSIGNED 
















H STUClNTS 
FRESENf 
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KEY FOR 1V36C 



lT37e 



STATE 
DISTRICT 
SCHCCL 



CODER 



ENGAGEMENT RATE FORM 
STATE #_03 SCHOOL tf OS. DAVE 4-Y\ GRADE J 

DISTRia I *\1 TEACHER # 



CODER a 



9 STUDENTS 
PRESENT At 



PART OF 
CLASS 
OBSERVED 
Beg. ✓ 

Mid. 

End 





TIME 


J — 


^ 




i 


5 


6 


7 




q 




11: 06 






IV* oi 


11*. 


\V*OS 




11*61 1 






ASSIGNED 












on 


^1 
** / 






to 

f- T 

SI 

Lit 


TRANSITION 










1 






4-7 




SOCIALIZING 


a-1 


















1 


11 *sTi PI INF 
ji 31*1 r uric 






















OBSERVING 












































TOTAL 

JNEKGAGED 




7-11 


3>-7 


8-11 


7- c J 


8-li 










[NGAGED 












N-AI 










ASSIGNED 


















- 




"tANAGEVENT/ 
TRANSITION 






















SOCIALIZING 






















DISCIPLINE 




















<_> 

1 


j^Ca'PIED/ 
D8SERVING 






















:ut OF RCCM 






















TOTAL 

JNENGAGEO 























ENGAGED 






















;ther 
assigned 






















PULL CUT 
ASSIGNED 


1 


I 


I 


1 


1 


\ 


1 






. i 


TO. OF 
STUCG.TS 

F.7ESENT 
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lT37f 

• 





i inn 


— L2— 


ii 


12 


13 


14 ' 


15 




ENGAGEMENT 
RATE 


tro*r 












TOTAL 


.to 

I 
1 


ASSlGiiEB 

1 


of C© 












•< / 1 


ENGAGED 
ASSIGNED 


KAfWGEKEKT/ 
TRANSITION 














OA ^ 1 


SOCIALIZING 


3-5 














DISCIPLINE 
















UJXCOJP 1 £Xi/ 
C3SESV1NG 


T-7 














OUT Or ROOM 














i 

i 


TOTAL 


















to -lb 














£ 


ASSIGNED 
















ENGAGES 




MANAGEMENT/ 
TRANSITION 
















ASS J uf«£ij 


SOCIALIZING 
















DISCIPLINE 
















UNOCCUPIED/ 
















GUT OF ROOM 
















TOTAL 
JNENGAGED 
















ENGAGED 


















OTHER 
ASSIGNED 




















UL GUT 
ASSIGNED 




















;t STu:t.'jTS 

FRESEN1 
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F*6* Demonstration of mastery on Engagement Rate Form 



The following pages include answer keys for videotape segments of 
three classrooms. These keys provide the correct categorization for each 
student for each observation- 
Each answer key includes the number of students present; a diagram 
showing the order of coding, location, and classification of each student* 
and the reasons for classification of all unengaged students. Students 
out of the room are also indicated. The location of each student is shown 
by a number and a letter; the number indicates the sequence in which 
students are coded, while the letter(s) indicates the behavior category. 
For example, on observation //l for classroom A, student 2E/U is the second 
student coded; he is located in the desk nearest the camera In the first 
row and is coded as either engaged or unoccupied, since he is looking at 
his book at first and then looks across the room. The behavior codes are 



The specific behavior of each unengaged student is described for each 
observation. Where the categorization of a student may vary, this is 
indicated by a slash- Thus, student 7E/U is the seventh student coded, 
and he/she may be coded as either engaged or unoccupied/observing. This 
may happen if the student changes behaviors during the time an observa- 
tion can be made* 

Two symbols are used on the picture to help observers: 



Note: Adding the minimums or maximums for the individual unengaged 
categories in an observation does not always yield the minimum or 
maximum for the total number of unengaged students, since some students 
may be coded in one of two or three unengaged categories (e.g., h/U) * 



as follows: 



E 
M 
S 
D 

U 

Ao 



Engaged 

Management /Trans it ion 

Socializing 

Discipline 

Unoccupied /Observing 
Assigned Other 




Empty desk 



Student has already been coded but 
has moved; do not code again (e.g. 
*8 — this was the eighth student 
coded; although he/she appears on 
screen again, skip him/her) 
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TEACHER COMMENTS FOR lV36a 



"What's a billfold? It f s another name for a? ... A wallet, good. And 
so Marybeth's father agreed to buy him something. Ok, let T s go to page 
one- twenty-six. ... Kim. ... Vet... What's that word, vet, mean? ... Ok, 
the dog is in the dog pound. Now who takes care of the dog? ... The 
doctor... He is called a? ... Veterinarian, right/ 1 

Observation #1 

"Be sure to remember, vet, ok. ... Eight, eight dollars. ... Very good, 
Karen. ... All right now, stop there. This is all part of having a 
dog, puppy, ok. All right, Rosa... Gory... You T re... That's... Silly, 
isn f t that? ... Thank you. ... All right, they decided on what, Jeanne 
Bottom? ... Penny, all right, that's one of the things, that's easy to 
call once you have decided on the name to call the pet. You decide 
what made him call him that. Ok. All right now, what we're gonna do 
is, is, for now I want you to go back to your seat. I want you to sit 
around this side here. This side, not that side, ok? This side so you 
have enough room. Look on the board and see what you have to do. I 
have three dittos I f m going to give you in a minute/ 1 

Observation #2 

"I want you to complete pages 41, 43, and 44. The second thing I want 
you to do is to copy the new spelling words. Those right there. There 
are ten of them. ... They are words for the next story. This story 
here. ... No, the other ones, here. Ok, the third thing I want — are you 
listening, Albert? ... is to do some extra writing. How are we going to 
find time to do that? All right, what I want you to do now is this. 
Ok. Go back. Sit along here. Get a pencil out and do these three 
dittos. As soon as you complete all three, staple them and put them on 
my desk. They are not due today. They are due Monday. Ok? ... As soon 
as you do that you move along and what do you do? Ron? ... Number two. 
Yes, and when you are all done with that you can go to your SRA folders. 
Ok, go right around here. Go this way... By Monday... Ok, Stephen, I 
want you to go to that side there next to Ronald. ... All right, for you 
people up here, if you are not done with the ditto I gave you — are you 
listening? Go to the story. Put aside and go on to the story. Go to 
the beginning of the story. If you are reading it already, I notice 
Veronica is, that's ok, keep reading it." 
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F.6. — Continued 

TEACHER COMMENTS FOR lV36a— CONTINUED 

Observation it3 

"Ok, I'll pass these out to you. I have two papers here. As I give 
them to you now the first thing I want you to do with them is what? 
... Albert, would you like to sit over there? There's more room. Ok* 
It's not gonna last... Put your name on it. ... Put your name on it. 
Turn that chair around back. Carol... All right, we will go over each 
one together real quickly. People up front there keep reading that 
story. I'll be with you in a second all right. We're going to begin 
from the very beginning. All right, everybody look at the last one I 
gave you. The one, you should be writing your name on it right now, 
at the top. Look at the bottom at the one that is page 43. Can you 
see that one? 43. Now this is similar to one you did yesterday. 
It deals with vocabulary in deciding which word will best complete the 
sentence. Now when you come across a word what do you always do? ... 
A word you don't know? Look it up. 0k. h 

Observation #4 

''Let's look at #5 for a minute 'cause that ink there really spread. 
It's hard to see that one word. Look at #5. Who will read it for me? 
Albert, will you read #5 please? Read the sentence to me. Now, the 
word on top is b-o-i-1. What is that? ... Boil. So if you want to 
copy that, copy it with your pencil. B-O-I-L. It looks like what? ... 
B-o-1-1. But it's an accident. It's i-1. It looks like that. It's 
i-lt I'm telling you now, it is i-1. All right. That goes for #10 
also. Now read that, Joe. #10 ... What's that word? not stew... 
Saw, ok? ... What's that word there? ... That word there is also boiling, 
b-o-i-l-i-n-g. .. boiling... Do you understand this now? ... Ok. Let's 
go on to the next one so that you understand. It's on page 44. The one 
with the block on it. See it? ... See that? The block? Now here, here 
again using a lot of the same words. Look at the words at the top of 
the paper. Read the words for us there, Ron, at the top of the paper. 
... Second word, Albert. ... Annoy, all right. You know what that word 
means. Stop annoying me. Don't annoy me. You know what that means, ok. 
How about the next word? ... World. Ok, next word... Destroy. Next word 
. , . Grange ... Now using those words complete the boxes, all right? And 
the blanks below that. Look at #1. This means to break. Raise your 
hand for me. Which word up there means to break? ... Destroy, so the 
"d" goes where? .*. and the rest of the blocks go with each letter. 
What do you think you do with that word? ... Look at the bottom of the 
sheet," 
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Continued 



TEACHER COMMENTS FOR lV36a— CONTINUED 



Observation 05 

"At the bottom, right. If you get the right word, you look at all the 
letters In that block, make up a word In Itself and they go down here. 
So make sure you get the right ones. All right let*s go on to the next 
sheet now. That Is page 41. It also is dealing with vocabulary words. 
Now this one here Is something else. This Is determining the order In 
which something happens In a story. This Is more dlfflcult t ok. ... 
Like what events happen when. Ok ... ok, now t Bob. Ok? All right. 
It says put the following stories 1 sentences in order. How would you 
number them in order? Underline signals. Signals means words that kind 
of tell you when the ' 'lings happened. Look at #1; it's done for you 
already. Albert, what*s a signal? ... What*s the underlined part? ... 
Read that to me. ... at eight o'clock... Ok, that tells you when something 
happened right there. It tells you what time of day. That*s the first 
thing that happened that day. Read the rest of the story, Albert. ... 
Now read louder, the one you were reading. All right, that was the first 
thing that happened. All right. Now you want to see what happened next. 
What it does for you is it gives you signal words. It gives you a word 
that kind of lets you know what happened next. Ok, what do you do with 
the signals? You underline them, the signal words. Then you put the 
number next to the sentence as you think they happened in the story, ok? 
Like what would you say happened next? All right, ten in the morning, 
ok. And the signal words would be ten in the morning. So that tells you 
when it happened." 

Observation J/6 

"So what would you connect to that sentence? What number? Two. 
That happened next. All right, so why don*t you do the other two first 
and then go back to this if you like. What will you be doing after this, 
Dan? If you complete these three? ... And put it on my desk, then what? 
... Ok, but take your time with the papers. Let*s not rush through 
these. Ok, any questions? Come up here and 1*11 answer any questions 
for you. Are there names on every one? ... Ok. Ok. People up here. 
Let*s turn to the beginning of the story. I think a lot of you have 
been reading it already and you have an idea of what the story is about* 
What is the name of the story, Dick? ... Communication-^Just Words. 
What does communicate mean? Who can tell me that? I*m communicating t 
what am I doing? ... All right, they tell you they what? *». They are 
happy. Are they saying anything to you or are they just smiling? Right. 
That*s a facial, a sign, that you are happy. What*s another way of 
communicating? From one to another... Talking. All right, what is 
another way of communicating? Hands, some people communicate by hands*, 
Ah, how about like, um, the way a person walks can you tell if they are 
nervous or something like that. ... Ok, all right, good. What other 
things? ... How they sit. How they sit. Always moving around. What, 
are they usually nervous. . .maybe upset about something. Ok, suppose we 
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P. 6. — Continued 

TEACHER COMMENTS FOR lV36a— CONTINUED 



Observation fl6- ~Continued 

sec someone crying? Could be two things... They're upset about 
something. What else? Someone's crying. Some people cry over what? 
... They got hurt. Some people cry because they are happy. They T re 
crying so much they're happy," 

Observation if? 

"They are so overwhelmed with joy. All right, these are ways of 
communicating. Ok. Let's read the story and the vocabulary words 
that are oh the board here. Let f s look at them. Number one is what? 
... Number... Not communication, but communicate. #2. ... #3. ... /M. 
... 5. ... 06. ... It f s a different kind of die - It's the second die. 
Ok. 07. marvel, not marvelous, but marvel. 8... Dial, 9... system, 
10... 11. ... lt T s a hyphenated word. Ok, and 12... All right now, 
you f ll see some of those words plus more new words that I f ll give you 
next week in the story. Ok, all right* who wants to begin reading? 
Veronica, ok, let's start reading on page 140... Ok, continue... Ring 
the doorbell. Good... All right. Who else would like to read? Lesley. 
All right, remember the beginning, what the title is? Communication — 
Just Words. Go ahead... Ok, Leslie, another paragraph. 1 ' ... 




Observation ItQ 

"All right* good. ... (PA announcement) Complete that for us, Kathy. 
Kathy... Ok... siren... You're right. ... Often what they tell." 



Observation #9 

"Ok, good. ... Very good, Kathy, very good. Would someone else like 
to read? Herb? ... What's that word? without. . .uttering. Good. ... 
By the look on their faces... Ok, good, thank you. ... Who else would 
like to read? ... Phillip Drury* all right..." 

Observation #10 

"Is your name on it? ... What's that? ... All right. Ok... Not painters, 
but— ok, stop there. . . . Maureen. . . continue reading. . . " 
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F.6, — Continued 



Observation #1 — 16 students 




8E/U 
9E 



10E 




Tea,cher ' s 
Desk 



3M 



5E/U 



6E 



7E 



11E/U 



12 E 

13E 
14E/U 



15E 



Large Table 





IE 



2E/U 



CO 



2E/U — Looking at book or 
looking across room 

3M — Moving papers around 

5E/U — Looking at book or 
looking at neighbor 

8E/U — Looking at book or 
looking around 

11E/U — Looking at book or 
looking across room 

14E/U — Looking at book or 
looking around 




16E 



4E 




8E/U 
9E 



10E/U 



Observation #2 — 16 students 




Teacher's 
Desk 



3E 
5E/U 
6E/U 

7E 




IE 

2U/E 



CO 

o 
2; 



2U/E — Looking around or 

looking at book 
5E/U — Looking at book or 

looking at camera 
6E/U — Looking at book or 

looking at camera 
8E/U— Looking at book and 

looking around room 
10E/U™Looking at book or 
looking at reading 
group 

11K, 12M, 13ft__Re turning 
14M, 15M, 16M to seats 




11M 

12M 
13M 
14M 
15M 



16M 



Large Table 



ERLC 



^ — Empty Desk 
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* — Already counted; do not code 
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ANSWER KEY FOR lV36a 
Observation #3 — 16 students 




4U 




8E 
9E/U/M 



10M/E 




Teacher's 
Desk 


3E 






5U 






6E/U 






7E/U 

































15* 





IE 



2U 



to 
o 



1LM 



12M 
13M 
14M 



16M 15M 



11* 



Large Table 



2U — Looking across room 

4U — Looking around 

5U — Looking around 

6E/U — Looking at book or 
looking across room 

7E/U — Looking at book or 
looking across room 

9E/U/M — Looking at book, 

looking around, or 
flipping pages, in 
book 

10M/E — Turning pages in book 

or looking at book 
11M — Walking to seat 
12M, 13M,__Putting headings 
14M f 15M on papers 
16M — Walking to seat or 

putting heading on 

papers 




Observation #4 — 16 students 



4E/U 




8E/U 
9E 




10U 



Teacher's 
Desk 



3E 



5E/U 



6E 



7E 




1E/U 
2E/U 



to 

O 

a 

55 



1E/U — Looking at book or 

looking around 
2E/U — Looking at book or 

looking at neighbor 
4E/U^ Looking at book or , 
5E/U looking around 
8E/U — Looking at book or 

looking around 
10U — Looking around 
13E/M — Writing on paper and 

waiting for teacher 
14M/E — Fixing papers or 
looking at paper 



13E/M 
12 E 
HE 



14M/E 15E 16 E 



Large Table 




— Empty Desk 



ERIC 



* — Already counted; do not code 
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ANSWER KEY FOR lV36a 
Observation #5 — 16 students 





10U 



Teacher 's 
Desk 



3E 
5M/S 
6M/S/E 
7E 




1U 

2U/M 



o 



1U — Looking at camera 
2U/M — Looking around or 

turning pages in 

book 

5M/S — Turning pages in 

book or Calking to 
neighbor 
6M/S/E — Turning pages in 
book t Calking to 
neighbor t or 
looking at book 
8E/U — Looking at book or 

looking around 
10U — Looking around 



14E 



15E 



16E 



13E 
12E 
HE 



Large Table 



Observation #6 — 16 students 



Teacher 1 s 
Desk 



3E 
5E 
6E 
7E/U 



IEI 




IE 
2E 



7E/U — Looking at book or 

looking at camera 
8U — Looking around 
9U/E — Looking around or 

looking at book 
10E/M — Looking at book or 
teacher giving 
nonacademic 
directions 



13E 
12E 
HE 



14 E 15E 16E 



Large Table 



— Empty Desk 



* — Already counted; do not code 
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Observation //7 — 16 students 



Teacher' s 
Desk 


3E 






5E 






6E 






7E 








1E/U 
2E 



to 
O 



1E/U — Looking at teacher 
looking around 



14E 15E 16E 



13E 
12E 
HE 



Large Table 



Observation #8 — 16 students 



4E 




8E 
9E 




10E 



Teacher's 
Desk 



3£ 
5E 
6U/E 
7E/U 




IE 



2E/U 



CO 

O 
Q 
2i 



2E/U — Looking in book or 
looking at camera 

6u/E — Looking around or 
looking in book 

7E/U — Looking in book or 
looking around 

11M/U — Turning pages or 
looking around 

12M — Walking to teacher's 
desk 

16M — Returning to seat 



14E 



16M 



15E 



13E 
12M 
lllt/U 



Large Table 



— Empty Desk 



* — Already counted; do not code 
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Observation //9 — 16 students 




8E 
9E 



10E/U 




Teacher's 
Desk 


3E/U 






5E 






6E 






7E 







16M 




1E/M 
2E/M 



o 



1E/M t 2E/M--Looking at book 
or waiting for 
next student to 
read 

3E/U — Looking at book or 

looking across room 
10E/U — Looking at book or 

looking around 
llE/S—Looking at board, 

looking at paper, or 

talking 

1AM — Putting papers in order 
16M — Returning papers to 
teacher* s desk and 
returning to seat 



13E 
12E 
11E/S 



1AM 



15E 



Large Table 



Observation #10 — 16 students 



5E 




9E 



10E 



13M 



12E 




Teacher's 
Desk 


AE 






6£ 






7E 






8U 








3H/E 

IE 
2E 



CO 

o 

Q 

2; 



3M/E — Walking to teacher 
or talking with 
teacher 

3U — Looking around 
room 

13M~Walking to learning 
center 

1AM — Putting papers away 
15E/M — Looking at papers 
or turning papers 



HE 



*3 16E 



15E/M 

*13 
1AM 



Large Table 



— Empty n *sk 



* — Already counted; do not code 
1.154 
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TEACHER COMMENTS FOR IV 36b 




Observation #1 

"When that's done, you're each going to get one of these multiplication work- 
sheets that we've been working on, with the riddle at the top* * * * 
We're also going to go over the two-digit multiplication < . * you remember , . < 
right, urn-hum, this type * . t all right t , . right , , t all right t , , When 
that's finished and in my wooden box - don't forget your name again - you're to 
go and find your measurement box, please* If you finish all that you are to do 
in there and your worksheet is out of your box, then just put it on the table*" 

Student: "What about Mrs. Hausel's group, we don't have a box yet?" 
Observation #2 

"All right, well then, of course, that will be with you. you don't have to be 
concerned about that , Question, Doug? " 

Student: 'tan we keep the boxes?" 

"* * i No, I use those every year* I f m sorry * . . All right, the next thing is 
free activity and X think you can tell me what ideas X have. Bobble Jo . . . 
The elephants, ok, the Elephant Timers - and if you use that will you share please? 
Now you know, if you have the box, share with someone else. Anything else you can 
think of? Greg, let's not . . ." 

Student: 1f Do our multiplication cards*" 
Observation #3 

n . . . All right, there are flashcards in the back* Very good. So X don't think we 
should have any trouble finding something to do if you're all finished. Ok, I f ll 
have your papers passed out in a minute and then you can be finishing your work. 
Megan, I would like you to finish this exercise . . . (Indecipherable) . * * Rusty, 
would you close your workbook please because these two need to be finished first.. * 

Ob servation M-tf9 

The teacher is workinR with individual students* 

O bservation #10 

"You can f t put the answers in until you add them. 
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F,6, — Continued 

Observation 0 1 - 16 Students 

L 



ANSWER KEY FOR lV36b 



BLACKBOARD 



14mQ 


10M| j 


p9E/M 


□ 5 « 


15M/ Up 


iiu/m| [ 


| [8E/M 


□ « 


16M Q 


i2M D 


| [ 7E/M 


| [ 3M/U 




13lQ 


| [6E/M 




El 


13 


El 





Teacher's des 



o 



The teacher is giving nonacademlc 
directions throughout most of 
the observations. 

1M, 2M, 16M — Looking at teacher 

give directions 
3M/U — Listening to directions 

or looking at camera 
4M, 5M, 10M— Looking at 

teacher give 
directions 
6E/M t 7E/M, ^Looking at teacher 
8E/M, 9E/M give example or 
nonacademlc 
directions 
11U/M— -Looking at hands or at 

teacher give directions 
12M t 13H t 14M— Looking at 

teacher give 
directions 
15M/U — Looking at teacher give 
directions or at student 
#14 




Observation # 2 - 16 Students 



BLACKBOARD 




I4M p 


iou/mQ 


□ 9H 


□ 5H 


15HQ 




n m 


□ 4M 










m 


13m| 1 


□ «< 


□ * 


X 






□ M 




X 


X 








Teacher's 


EI 

desk | | 
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count.* J; do 



The teacher is giving directions 
throughout the observation (no 
academic content), 

1M, 2M, 3M — Looking at student 
asking question 
about directions 
4M t 5M t 6M t Looking at teacher 
7M, 8M, 9M " give directions 

10U/M--Staring at desk or 
looking at teacher 
give directions 
11M, 12M — Looking at teacher 

give directions 
13M — Looking at teacher give 
directions or turning 
pages in book 
14M* 15M, 16M — Looking at teacher 
give directions 
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F. 6. —Continued ANSWER KEY FOR lV36b 

Observation tf 3 * 16 Students 




^" BLACKB OARD ^ e teacner * s Ri v ^ n 8 directions 

throughout the observation 
(no academic content) „ 

1M— Looking at teacher give 

directions 
2M/U, 3M/U--Looklng at teacher 
give directions or 
looking around 
4M/U — Looking at teacher 
give directions or 
looking at camera 
5M-- Waiting for papers 
6M — Turning pages 
7M, 8M, 9M— Getting ready 
for next 
activity 
10M — Waiting for papers 
1 1M — Turning pages 
12M/U — Turning pages or 

looking at neighbor 
13M™ -Looking at teacher 
give directions 
. , # t [ 1 1AM — Turning pages 

Teacher's deslj 1 15M/B— Looking at teacher 

~z_ give directions or writing 



i/ M r~i 


1 fW 1 1 

I0H I 1 


n 9M 

\ 1 


n 5M 


15M/EQ 




□ m 


□ */o 


16EQ 


12M/0|_| 


r™ 1 7M 


[ I 1M/U 




13MQ 


□ 6M 


□ 2M/U 


■ H 


12 . 

12 




El 



Observation # 4 - 16 Students 






BLACKBOARD 




1 




ioeQ 


□ ' E 








□ »U/E 


□ « 




12EQ 






12 


13eQ 


□ « 


□ * 




12 


|2 


QlE/M 




12 


El 


12 



1E/M— Working In workbook or 

getting worksheet 
2M — Sitting down and sorting 
papers to get ready for 
activity 
8U/E — Looking at camera or 
writing 



Teacher's desk j 1 
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ANSWER KEY FOR !V36b 



Observation 8 5 - 16 Students 



r 



BLACKBOARD 



14E 



15E 



16E 



□ 




□ 9E 


□ 


□ 


iimQ 


QSE 


□ 


□ 


12EQ 




□ 




13EQ 


□« 


□ 




IS 


12 


□ 


12 


El 


12 


13 
12 






Teacher' 


3 des 



5E 



4E 



3E 



2E 



11M — Walking to teacher 
for help 



a 



Observation #6-16 Students 



BLACKBOARD 



14uQ 






□* 




12EQ 








12 


10M 1 — ' 




El 


13M/uQ 






12 
12 


12 

12 


12 
12 


Qe 

12 



2M — Taking workbook to 

teacher's desk 
3U— Looking at camera 

— Looking at student #2 
1GM — Getting materials 
13M/U — Picking up paper or 

looking around 
14U — Staring Into space 



ERLC 



Empty Desk 



Teacher's desk f [ 
1.158 
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F.6.~Ccmtinued ANSWER KEY FOR !V36b 

Observation 0 7 - 16 Students 

i 



BLACKBOARD 













o 


16EQ 




[> 


r i 

□« 






El 






1 El 
El 








Teacher 1 


El 2,1 

1M 



1M, 2M— Waiting for teacher's 
help 



across room 



9 

ERLC 



Observation # 8 - !*> Students 



BLACKBOARD 



HE 



o 

16E/MQ 



151 



iieQ 

□ 



10E 



12E 



9E 



13E 



□ 



□ 
□ 



□ 

□ 5E/M 
□ 
□ 
□ 



1M/E — Watching teacher correct 
workbook or getting help 
from teacher 
6E 5E/M—Writing; then stands 

up to get work checked 
16E/M — Writing; then goes to 
teacher*s desk 



3E 



E) 



Teacher's dtisk [ | 
1.159 
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F.6. — Continued' 
Observation 9 9 - 16 Students 



ANSWER KEY FOR lV36b 



BLACKBOARD 



15E 



P 

161 Q 



14E/U □ 



□ he 

□ lOE 

□ « 



□ 



7M 



6U 



□« 
L> 



2M— Waiting for help 

from teacher 
6U — Looking around 
7M--Getting measurement 

box 

8U--Staring across room 
14E/U— Looking at paper/ 

playing with pencil 
or smiling at camera 



Teacher T s desl 



2M 




9 
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Observation #10- 16 Students 



BLACKBOARD 



15U/e[ 1 llt{ [ 


Qoe 


□« 




l2E D 


Qe 




E 


1 13E D 


□ 8E 




m 


1 


Qe 
□ 






X 


Teacher Vs 


.13 

2M 

desk ( | 



Teacher is explaining 
incorrect answer . 

IE — Listening to teacher's 
explanation of incorrect 
answer 

Waiting for help 
from teacher 
15U/E— Looking around or 
at book 



i?5 
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Eiapty Desk 



* Already counted; do not code 
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F.6. — Continued 



ANSWER KEY FOR lV36c 
Observation #1 — 27 students, 1 pullout 




Teacher's 
desk 



*8 

24 S 
25E 



J 

t 

26E] 
r 

'!. 



27E/U| j20U/E |__ 




J 



18E 17E 



r 



*6 



t 



14 
M/U 
13 
E/S 

12S 

HE 
10 

E/U 

9E 





7U 

f 

5E 
4E 
3E 
2U 
IE 



6M 



8S 



2U — Staring with hands over 
face 

6M — Walking to get materials 
7U — Looking at student #6 

walking 
8S~ Talking to student #1 
10E/U — Looks down at floor 

of lap briefly 
12S— Talking to student #13 
13E/S — Talking to student 

#12 

14M/U—Asking student //6 for 
paper or looking 
around 
20U/E — Looking at paper 
23U — Watching reading group 
24S— Talking to student //8 

walking 
27E/U — Looking around or 
looking at paper 




Observation #2 — 27 students, 1 pullout 



Teacher 1 
desk 



T 



23E 

T- — 




24lj 
25Ej 


22M 






21E 


27EI 

t, _ J 


20E 
19E 



18E /^\14E 
17E/tT~*l& E 



nu 

US 

us 



; j. 

10 

f JM/U 

(9E/U 



i 

i 

r 

; j 



8E 



7E 
6E 



5E 

4U/E 

3E/U 
j 2U 

i IE 



2U, 13U — Looking around at 

reading group 
3E/U — Staring at paper 
4U/E — Looking at neighbor 
or at paper 

9E/U — Looking at paper 

or camera 
10M/U — Returning to desk 

ox watching student 
US, 12S— Talking 
17E/U — Looks up at camera 

briefly 
22M— Walking back to desk 
24U — Looking around 



« Empty desk 



o 



-- Table 



* — Already counted; do not code 
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ANSWER KEY FOR lV36c 
Observation #3 — 27 students, 1 pullout 



Teacher's 
desk 




lSE/^x 14E 

.5E 
L6E 



1 OEy*^V 1 H 



13E 

12 
U/E 
1 IE 

10E 

9E 

8E 




7E 
6E 

5E 

4U/E 
3E 

2E/U 



lS--Talklng to student #2 
2E/U — Looks up at camera 

brief ly 
4U/E — Looked up at camera 

briefly 

12U/E-- Looking a t reading 
group 

24U/S — Playing with pencil 

or socializing 
25U/S — Looking at camera 

or socializing 
27U/E — Looking at student 

#26 or reading group 

or writing 



IS 



Observation #4 — 27 students, 1 pullout 



22Mf 



Teacher's 
i desk 



23U/EJ 




. l~Out of room 

6U — Wandering around with 

no apparent purpose 
8E/U — Lcolcing at camera; 

then looking at paper 
9U — Looking at neighbor's 

paper 

11E/U — Looking at reading 
group 

18M~Walking to desk 
21U — Looking at camera 
22M — Sharpening pencil 
23U/E — Looking at student 

#22 or at paper 
24U — Looking at reading 
group 

27U — Looking at student 
#26 f s paper 



6U 



Empty desk 



o- 



Table 



1 - out of room 

* — Already counted; do not code 
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ANSWER KEY FOR lV36c 
Observation #5 — 27 students, 1 pullout 



19V s~ N 15E 

L6E r 



U 1 ' 

lSE^-^E 





gu/E 



8E 
7U 

6E 
5E 
4E 
3U 
2E 



7U # 14U, 220— Looking at 
reading group 

1M— Getting a drink of 
water 

3U — Looking at camera 
9U/E — Could be looking at 

reading group or at 

paper 

12U — Staring and playing 

with nose 
23U/E — Looking at reading 

group or writing 
27U— Looking at camera 



1M 




Observation #6— 27 students, 1 pullout 




19E^"\X 5E 
I8E^ 

I 

i 




1M 



7U — Looking at reading 
group 

1M — Getting a drink of 
water 

3U — Yawning and looking 

around 
AM — Changing papers 
6M — Getting up for paper 
8K/U — Looks up fit reading 

group briefly 
11U — Scraping at top of 
desk 

14U/E — Looking at camera 

or writing 
20U/E — Looking at reading 

group or writing 
21K — Getting crayon 
25U — Playing in desk 



Empty desk 




o- 



Table 



* — Already counted; do not code 
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ANSWER KEY FOR lV36c 
Observation #7 — 27 students, 1 pallout 



24M/U 



/ — • ^16E 
( )"E 





7E 

6E/M 

5E 
AM 
3U 

2E/U 
IE 



7U, 23U, 27U— Looking at 
reading group 

AM, 15M — Getting materials 
2E/U — Looks around briefly 
3U — Staring 

6E/M — Writing or looking 

for materials 
10M — Walking to water 

fountain 
12U/E — Looking at camera or 
paper 

14S/U— Giggling or looking 

at board 
15M/U— Walking to get 

materials or 

wandering 
24M/U — Getting materials or 

wandering 
25U — Playing under desk 




Observation #8 — 28 students 



*10 



24M/U! 




28U/M, 



15M r * 
L6M 



lTM^yl 




3E/U — Looks at reading group 

briefly 
AE/U — Looks up at camera 
6E/U — Looks up briefly 
13U — Looking at reading group 
14M, 15M, 16M, 17M, 18M— 
Turning pages in books 

23E/M — Looking at book 

or turning pages 
24M/U — Getting materials or 

wandering around 
25U— Playing under desk 
26U™ Watching student #27 
or #28 

27U— Watching student #28 
28U/M — Looking at camera or 

putting away 

materials 
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Empty desk 



o-- 



Table 



* — Already counted; do not code 
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ANSWER KEY FOR lV36c 
Observation #9 — 28 students 




Teacher ' s 
desk 



17E A3E 



23S 
24U~/S 
25S 



28M 



iV ; ' 1 

H 



22U 



2 IE 



20E 
19E 



27Mi J 18E/U j 




6E 
5E 

AM 

3U/E 

2U 

IE 



2U — Looking at camera 
3u/E--Looks up briefly 
AM — Walking to get materials 
12E/U — Looking at board 

or writing 
18E/U— Looks up briefly 
22U — Looking around 
23S— Talking to student #24 

under desk 
24U/S— Playing under desk 

or socializing 
25S, 26S— Talking 
27M, 28M— Getting materials 




Observation //10 — 28 students 



j Teacher' 
! desk 



J 



t22U 



23S| i 

* j 

24S| 



25E! 




27Ao; 



*6 



!-— i 



21E 
28M 
20E 
19E 






Empty desk 



ERIC 



18E / ^-04E 
[ U5E/U 



17E 




O 



— Table 



2U — Looking at student #1 
3U™Looklng at reading group 
4Ao, 27Ao — Doing free-time 

activity 
6M/U/S — Getting ready to work, 
looking at camera, or 
socializing 
7U/S — Looking at camera or 

socializing 
lOM—Putting crayon away 
11M/U, 12M/U — Getting materials 

or playing 
13S — Talking to student across 
room 

15E/U — Looks up briefly 
22U— Playing with pencil 
23S— Talking to student #24 

under desk 
24S — Talking to student #23 
26U — Stretching and looking 

at camera 
28M~Walking back to desk 

from bathroom 



* — Alreadv counted; do not code 
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G. Allocated Time Log (55-60 minutes) 




*1H38 
or 
1H40 




Rationale . Participants need to know how allocated time relates to 
student engaged time and why information on allocated time is 
collected. They need to be able to complete records of the time 
allocated for reading/language arts and math. 



Materia Is 

1H21 — Time Glossary 
(a-b) 

*BT2 — Blank Allocated 
Time Log 



1H38 — Sue Lee's 
(a-b) Classroom 

— Allocated Time 
Log (1) 
1T39 — Answer Key for 
1H38 



1H40-- Lisa Hadley T s 
(a-b) Classroom 

— Allocated Time 
Log (1) 
1T41 — Answer Key for 
1H40 



*/lH42— Allocated Time 
(a-b) Log 

— Allocated Time 
Logs (4) 
1T43— Key for /1H42 
(a-d) 



Strategy 

Review the definition of allocated 
time and its relationship to student 
engaged time. Explain why information 
on allocated time is collected. Give 
information about the Allocated Time 
Log, explaining its format. 

Explain how Sue Lae completed the 
log for reading /language arts. Note 
that all students have the same 
assignments* See Note G.2 for a 
detailed description of this activity. 
Ask participants to complete the log 
for math for Sue's class. Check 
answers and discuss any difficulties. 

Explain how Lisa Hadley completed the 
log for reading/language arts. Note 
that in her class different groups of 
students may have different assign- 
ments during a time period. See Note 
G.3 for a detailed description of 
this activity. Have participants 
complete the log for math for Lisa T s 
classroom. Check and discuss answers* 

Have participants complete Allocated 
Time Logs for one of the classrooms 
described in independently and 

check their answers. In the classroom 
described on /lH42a| all students have 
assignments in the same subject in 
each time period; in the classroom 
described on /lH42b| different parts 
of the class have assignments in 
different subjects during some time 
periods. If an answer is incorrect, 
try to give the person a hint that 
will help him/her to correct the error 
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Allocated Time Log — Continued 



Materials Strategy 



(e.g., you skipped a column! how about 
the top, look at this column again). 
Discuss any difficulties. Have 
participants complete Allocated Tine 
Logs for the classroom described in 
Appendix G (/lH42c) if necessary (i.e. f 
if procedures used were incorrect or 
if there were numerous arithmetic 
errors). Check the answers. If anyone 
is still having difficulty, work with 
that person individually at a later 
time. 



Alternative Strategies 



1. Complete only one example (1H38 or 1H4Q) in the session. If 
teachers 1 schedules are simple (e.g., same assignments for all 
students during each time period) t use 11138$ otherwise, use 1H40. 

2. Complete only one example (1H38 or 1H4Q) in the session; have 
participants complete the second example independently between 
meetings. 

3. Have participants complete the checkpoint (/1H42) independently 
between meetings. Check and discuss answers in the next session. 



Vtl. Collecting information on allocated time (5 minutes) 

a. Allocated time as a component of student engaged time ( lH21ft ) 

(1) Definition — amount of time teachers spend on instruction 
in a content area 

(2) Student engaged time - allocated time * engagement rate 

(3) Increasing (or decreasing) allocated time increases (or 
decreases) student engaged time (other things 
remaining equal) 

b. Ways to collect needed information 

(1) Log is most convenient form 

(2) Teacher fills out for all instruction in the subject 
area(s) observed only on days observed (See Note D.l.b.) 

(a) Completed before, during, or after class 

(b) Older student may be able to complete 



1.167 



(3) Need for log—actual allocated time not always same as 
Intended 

(4) Beneflta of log 

(a) Teachers become more aware of loat allocated time 
aa they keep recorda 

(b) Analogy to behavior modification of smoking — 
keeping a record of the number of cigarettes smoked 
reaults in fewer amoked 

tc. Allocated Time Log ( BT2) 

(1) Information at top 

(a) Subject area — uae different form for each subject 
area (e*g*> reading /language arta on one and math 
on another) and/or for each claas (if more than 
one group of students is taught) 

(b) Number of atudenta preaent 

(2) Column headings 

(3) Activities — change when atudents in classroom are 
reassigned to different tsaka (e.g. t reading groups, 
spelllng t math drill) 

Example of Sue Lee T s clasaroom ( 1H38 . 1^39) (15 minutes) 

a. Simple schedule — whole claaa aaaigned to aame subject ares(s) 
during each time period 

b. Log for reading/language arta 

(1) Entries during day 

(a) Description of activity and beginning time 
(column A) 

fb) Ending time f column B) when assignments change 

(i) Activity #2— ending time not same for all 
students since working independently on 
assignments in two different subject areas; 
Sue records "varies 11 

(c) Time in minutes (column C) * ending time - 
beginning time (B - A) 

(i) Activity #2 — Sue estimates time needed by an 
"average" student to complete the reading 
assignment 

(2) Calculations at end of day— add laat column to get total 
allocated time for reading/ language arts 

c. Log for math 
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f3. Example of Lisa Hadley's classroom Qji&tt, ilii) (20 minutes) 

a. Reading/language arts 

(1) Entries during day 

(a) Description of activity and beginning time (column A) 

* 2 or 3 (b) Ending time (column B) when assignments change 

(i) Activity #4 — ending time not same for all 

students since working on several assignments 

in different subject areas; Lisa records "varies" 

(c) Time in minutes (column C) - ending time (column B) 
- beginning time (column A) 

(i) Activity #2 

• About half the students (12) are assigned 
to reading, so Lisa multiples H x 44 
minutes to get: 22 minutes 

• Students need not be in classroom — if 
these 12 were in Title I class, same 
numbers would be recorded 

(ii) Activity #4 — Lisa estimates time needed by an 
"average" student to complete the reading 
assignment 

(2) Calculations at end of day 

(a) Total time for reading /language arts — add ^ast 
column 

b. Math 

4. Demonstration of mastery ' f /lH4? y 1T43 ^ (15-20 minutes) 

^ a. Directions for checkpoint 

b. Directions for Allocated Time Log 

^4.c c. Example of Ann Riley's classroom— reading/language arts and 
or math (whole class in same subject) 

d. Example of Tony Casini's class rooo™reading/ language arts 
and Tnath (different students assigned to different subjects) 



I 
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Materials 



In addition to the materials included in this section* the 
following are needed: 



1H21 
(a-b) 

BT2 



Time Glossary 



(Topic C) 



Blank Allocated Time Log (Appendix B) 
Allocated Time Logs (2-6) (Forms) 



Included in Appendix G are the following supplementary materials: 

/GH42c Erica Swenson's Classroom (different groups 
assigned to different subjects) 

GT43 Key for /GH42c 
(e-f) 
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lH38a 



EXAMPLE OF SUE LEE f S CLASSROOM 

Sue Lee is a fourth grade teacher at the fictional New Del pen ^ 
Elementary fchool in Eastern School District, Atlantic State. 
The following table presents a description of activities in 
Sue f s classroom on October 8. Twenty-three children were 
present on this day. Sue's code numbers are: 

State— 03 District— 47 School—08 Teacher--YI99 




Time 

8:30 - 8:45 
8:45 - 10:39 
10:39 - 11:14 

11: 14 - 11:43 
11:43 - 12:46 
12:46 - 1:31 
1:31 - 2:45 



Activity 

Opening exercises 

Reading groups 

Reading and art seatwork 
Reading—about 20 minutes 
Art — about 15 minutes 

Spelling 

Lunch and recess 
Math lesson 

Math and science seatwork 
Hath™about 20 minutes 
Science— about 54 minutes 



2:45 - 2:59 



Mus ic 



Sue has completed an Allocated Time Log for reading/ language arts as 
shown on lH38b< Complete a second log for Sue f s classroom for math. 




Q&q.nu%w 291 — e l<*y adunBuv f j/Bu y ipvay 



ERIC '- 171 J 56 



STATE AttarAic 1 ALLOCATED TIME LOG 

DISTRICT EasWn i SUBJECT R«oAV«a /l*x\<\. 
SCHOOL Meui l>*Wn i STATE § SCHOOL # 0* DATE to/* NO. OF STUDENTS 
TEACHER Let 1 DISTRICT #*41 TEACHER #YTfl GRADE H PRESENT 




ACTIVITY 


BEGINNING 
TIME ® 


ENDING 
TIME® 


TIME IN 
MINUTES (g) 


1 






10 : VI 


M | 


2 






Varies 


AO 


3 




WW 




PI 












5 










6 










* ' TOTAL 


ICo5 



00 

o 
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STATE A+UnVic 

DISTRICT Ea.&Wr> 
SCHOOL J^^eWi 
TEACHER Lee 



ALLOCATED TIME LOG 

STATE # 03 SCHOOL § 01 DATE \ok 
j DISTRICflrf TEACHER #"tt<?? GRADE^T' 



SUBJECT fVWlU 
NO. OF STUDENTS 
PRESENT 



o 



ACTIVITY 



Lesson 



BEGINNING 
TIME 



® 



ENDING 
TIME (|) 

Varies 



TOTAL 



TIME IN 
MINUTES (t) 

3lO 



ERIC 



199 



130 



CO 
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EXAMPLE OF LISA HAJ>LEY T S CLASSROOM 

Lisa Kadley teaches first grade at the fictional 
New Delpen Elementary School In Eastern School 
District* Atlantic State. The following table 
presents a description of activities in Lisa's 
classroom on Wednesday, October 10. There were 
25 students present on this day. Llsa T s code 
numbers are: 

State— 03 District— 47 School — 08 Teacher~WKI2^ 





Time 




Activity 


Number of 


O J JU - 




Opening exercises 


25 


8:46 - 


10:01 


Reading groups and 
sea two rk 


25 


10:01 


- l o ; 30 


Recess 




10:30 


- 11:14 


Reading groups and 
sea two rk 

Art projects 


12 
13 


11: 14 


- 11:44 


Spelling 


25 


11:44 


- 12:45 


Lunch and recess 




12:45 


- 1:45 


Math lesson and 
sea two rk 

Art projects 


17 
B 


1:45 - 


2:25 


Language arts and 
math seatwork 

Language — about 15 mins. 

Math-- about 25 mins. 


25 


2:25 - 


3:00 


Music 


25 



Lisa has completed an Allocated Time Log for reading/language arts (lH40b). 
Complete a second log for math for Lisa's class. 




eric h174 



STAT E Allanlic 
DISTRICT EaaWn 
SCHOOL H^^lften 
TEACHER WoAXe.j 



ALLOCATED TIME LOG 

SUBJECT TWwq/Um. 
STATE # Q3 SCHOOL # Qg DATE lo/to NO. OF STUDENTS =r 
DISTRICT Ml TEACHER # max GRADE 1 PRESENT 35 



ACTIVITY 


BEGINNING 
TIME ® 


ENDING 
TIME® 


TIME IN 
MINUTES © 


1 


KeadUr^ groups 




lO:Ol 


75 


2 




10:^0 


\\. w 


a a* 


3 




H-. 14 




30 


4 




1:45 


•Varies 


15 


5 










6 











er|c 



*Adjusted since only half of class assigned 



TOTAL 








STATE AUan*i<i ! 
DISTRICT Easier a 


1 

ALLOCATED TIME LOG ! 

SUBJECT fWYW 


SCHOOL Meu) %n 


» STATE # 03) SCHOOL # OS DATE \o/\o NO. OF SiUJENTS 


1EACHER i 


D ! STR 1 CT # 4"7 TEACHER # uvx * GRADE t PRESENT 5 5 j 



00 



ACTIVITY 



Lesson <xw^ seocVojork 



BEGINNING 
TIME ® 



UU*J5 



ENDING 
TIME (D 



\-.45 



Varies 



TIKE IN 
MINUTES © 



Ho 



3,5 



4 



5 



*Adjusted since only two-thirds of class assigned 



TOTAL 



ERIC 



194 



195 
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ALLOCATED TIME LOG 



The following pages present descriptions of activities in two teachers 1 
classrooms on different days. Complete an Allocated Time Log for 
reading /language arts and for math for at least one classroom and then 
check your answers. If you have difficulty or would like additional 
practice, complete the Allocated Time Log for reading/language arts and 
for math for the classroom described in Appendix G. 

Ann Riley teaches sixth grade at the fictional New Delpen 
Elementary School, Eastern School District, Atlmtic State. 
The following table describes activities in her classroom on 
September 28. Twenty students were present on this day. 




Time 


Activity 


8:45 - 9:00 


Opening exercises 


9;00 - 10:15 


Reading groups and seatwork 


10:15 - 11:15 


Reading seatwork. and science 

activity 

Reading— about 40 minutes 
Science— about 20 minutes 


11; 15 - 11:30 


Hath drill 


11:30 - 12:30 


Lunch and recess 


12:30 - 1:15 


Math lesson and seatwork 


1:15 - 1:45 


Gym 


1:45 - 2:05 


Spelling 


2:05 - 2:20 


Sustained silent reading 


2:20 - 3:00 


Social studies 



ERIC 
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Tony Casini teaches third grade at the fictional New Delpen 
Elementary School, Eastern School District, Atlantic State* 
The following table describes activities in Tony f s cla**- 
room on Thursday, March 15* Twenty-eight students were 
present on this day* 



Time 

8:30 - 8:45 
8:45 - 10:00 

10:00 - 10:30 
10:30 - 11:14 

11:14 - 11:44 
11:44 - 12:45 
12:45 - 1:30 
1:30 - 2:15 
2:15 - 3:00 



Activity 

Opening exercises 

Reading groups and 
s^atwork 

Recess 

Reading seatwork 

Science 

Spelling 

Lunch and recess 
Math lesson 
Gym 

Language arts and math 

seatwork 

Language— 25 minutes 
Math — 20 minutes 




Number of Students 
28 

28 

14 
14 
28 

28 
28 

28 



Complete an Allocated Time Log (front and back) for reading/language 
arts and for math for Tony f s class. 
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STATE Atiar^ic | 

DISTRICT Eastern ! 

SCHOOL MfcuiT>fcAt><.n | STATE § 

TEACHER Ry\e^ j DISTRICT # 



ALLOCATED TIME LOG 



SCHOOL #_ 
TEACHER » 



SUBJECT Rtaaiftg/Uttg. 
DAT E NO. OF STUDENTS 3 

GRADE I PRESENT AO 



o 



erJc 



ACTIVITY 



Reading groups ^ Sea+ojork 



BEGINNING 
TIME ® 



10 : IS 



1:45 



ENDING 
TIME® 



10: IS 



Vanes 



TOTAL 



TIME IN 
MINUTES © 



40 



AO 



/SO 



199 



STATE A+l<xn*i 



DISTRIC T Eastern 
SCHOOL Mem 



STATE II 



SCHOOL # 



ALLOCATED TIME LOG 

SUBJEC T (V-VVi 
DATE NO. OF STUDENTS 



:09 



TOTAL 



er|c 



v 




(oQ 



t—* 



00 

o 



ACTIVITY 


BEGINNING 
TIME 


ENDING 
TIME 


TIME IN 
MINUTES 


1 


Drill 


\\> \5 


tl-Bo 


15 


2 


Lesson £ SeccVtoock 




I: IS 




3 






* 




4 










5 










6 








i 



o 



1 



201 



CO 



STATE A-Han*ic 
DISTRICT EasWA 
SCHOOL Neuit>eJp*n 



ALLOCATED TIME LOG 



STATE # 



DISTRICT # 



SCHOOL § 
TEACHER I 



SUBJECT RcaA ; /Una 
3/tS NO. OF STUDENTS 3 3 



DATE 

GRADE 3 PRESENT A3 



ACTIVITY 


Dcr i mm i kir 

TIME 


run i f ir 
TIME 


1 I fit m 

MINUTES 


1 


RtaAirtj group* $ S«.<xW>rk 




lo-.oo. 




2 




10". 2>0 


fc ft 


.a. 


3 


Sj>ell *^ 






3>o 


4 


Language *rts S€ccVuwrk 


a'-is 


Vair i e s» 




5 










6 


■ 








*Adjusted since only half of class assigned 


TOTAL 


152- 



-V 



201 



202 



STATE W-U^ic I ALLOCATED TIME LOG 

niCTo'iPT n _ i i QliRim f/\ -Ik 

U 1 o 1 K 1 L 1 cftVfer ^ ' oUd JtL 1 ri or n 

SCHOOL WeuJ DeWrs 1 STATE # SCHOOL # DATE 2>/iS NO. OF STUDENTS 
TEACHER Cast ni 1 DISTRICT # TEACHERS GRADE 3 PRESENT a% 




ACTIVITY 


BEGINNING 
TIME 


ENDING 
TIME 


Tlhc IN 
MINUTES 


1 


Lesson 




|:30 




2 




£ : IS 






3 










4 










5 










6 












TOTAL 


G>S 
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Notes 

The following notes are included in this section: 
G.l.c. Allocated Time Log 
G.2* Example of Sue Lee's Classroom 
G.3. Example of Lisa Hadley*s Classroom 



• 
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G.l.c. Allocated Time Log 



The Allocated Time Log Is a dally log that may be used by teachers 
to record allocated time. In the upper left-hand corner, the teacher 
Is Identified. In the upper right-hand corner, the grade, date, subject, 
and number of students present are recorded. (Note that If a teacher 
wishes to share his/her data without revealing Its source, the Information 
can be coded along the top center of the form; the left-hand comer can 
then be cut away.) 

A different form Is used for each subject. Reading and language 
arts activities should be recorded on the same form unless the number of 
students present differs for these subjects (e.g., If a teacher has 25 
third-graders for reading and 18 third- and fourth-graders for language 
arts, he/she would use one log for reading and another for language arts.) 
Similarly, a teacher who has different groups of students for the same 
subject should use one form for each class. 

Whenever a group of students Is assigned to reading/ language arts 
or math, the teacher describes the activity (e.g., reading groups, 
spelling t math drill) and records the beginning time (column A). The 
teacher records the ending time (column B) when the activity is completed 
or assignments change. He/she also finds the time in minutes (column C) 
for that activity for each student by subtracting the beginning time from 
the ending time (column B - column A). 

If students are working on assignments in more than one subject area 
during an activity (e.g., "finish your language sea two rk and then begin 
this science assignment") f the teacher records "varies 11 as the ending time 
in column B and estimates the time needed by an average student to complete 
the activity to find the time in minutes (column C) . 

If different groups of students are assigned to different subjects, 
then the teacher adjusts the time in minutes by multiplying by the fraction 
of the class in the appropriate subject area. For example, if two-thirds 
of the class is doing reading sea two rk and one^thlrd is doing a science 
activity from 10:15 to lis 15 t then the time in minutes for reading is 
2/3 x 60 minutes - AO minutes. 

At the end of the day, the teacher adds the allocated times for each 
activity to get the total allocated time for the subject area. 

In addition. to using the Allocated Time Log to record the average 
allocated time for a class, some teachers may wish to record allocated 
time for a certain group or groups of students. In such a case, the 
teacher simply uses a different Allocated Time Log for each group. 
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G.2. Example of Sue Lee's Classroom (whole class assignments) 



This note discusses step-by-step one of the examples that Is used 
In the session (1H38). Directions are In Italics and are meant to be 
completed as you read through this note; these same directions may be 
appropriate to use as you present the example. 

The example on 1H38 concerns Sue Lee*s fourth grade classroom 
activities on October 8* Sue's classroom schedule Is relatively 
simple; all students are working In the same subject areas during each 
time period. Sue first completes the Information at the top of the 
log at the beginning of the school day. 



STAT E AtitrtKc i AU^ED TIME LOG 

DISTRICT Ea.%+e.rr\ 
SCHOOL 
TEAG'ER 



CT Eastern f , S0B.lEa Wlw<\/Uwt. 

^wesU&q ; s:ate # 03 school # &s dat e «yg no. of stluents 

S t La J r { DISTRICT j} M7 TEACHER #H3W C3[ PRESBiT 33 



The whole class is Involved in reading and language arts activities 
from 8:45 until 10:39, when students are given reading and art assign- 
ments. For Activity #1, Sue records a description of the activity and 
the beginning time. These entries are recorded below. 



(A) (B) (C) 



ACTIVITY 


BEGINNING 
TIME 


DOING 
TIME 


TIME IN 
MINUTES 


1 


RftfluA»n3 groups 








2 










3 











When assignments change at 10; 39, Sue records the ending time for the 
first activity and finds the time In minutes by computing ending time 
minus beginning time. Then she describes the second activity and 
records the beginning time. These entries are circled on the next page. 
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(A) 


(B) 


(O 


ACTIVITY 


EEC 1 WING 

1 ml 


ENDING 
TIME 


T1V£ IK 
MiKUTES 


1 










2 










3 











Since students may finish the reading assignment at different times* 
Sue records "varies" for the ending time for the second activity. To 
find the time in minutes, she estimates the time needed by an average 
student to complete the reading assignment (20 minutes). Sue then 
describes the third activity and records its beginning time. These 
entries are circled below. She records the end of spelling class as 
the end of the third activity and finds the time in minutes. These 
entries are enclosed in triangles below. 



(A) (B) (C) 



ACTIVITY 


BEGINNING 
TIME 


ENDING 
TIME 


Ttt£ IN 
MINUTES 


1 


Re<wiiag groups 






ni 


2 






paries 




3 











At the end of the day fc Sue adds the time in minutes column to find 
a total allocated time for reading/language arts of 163 minutes* 

Sue completes another log for math. Fill out the information at 
the top of the log for Sue. 

The whole class is involved in a math lesson from 12:46 to 1:31. 
Describe the activity and record the beginning time. Then record the 
ending time and find the time in minutes. 
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The gIosb has multiple assignments in math and science from 1:31 
to 2:45. Describe the activity and complete the beginning time* ending 
time A and time in minutes columns* 

Find the total allocated time for math by adding the last column. 
Check your answers with those on the answer key (1TZ9). 



G.3. Example of Lisa Hadley'8 Classroom (different groups assigned 
to different subjects) 



This note discusses In detail one of the examples used In the 
session (1H40). Directions are In Italics and are meant to be completed 
as you read; these same directions may be appropriate to use as you 
present the example. 

The example on 1H40 concerns Lisa Hadley*s first grade classroom 
activities on OcLober 10. Lisa* s schedule Is rather complex; different 
groups of students are assigned to different subject areas during a 
single activity period. Lisa first completes the Information at the 
top of the log. 



STATE AjUpi^ j ALLQCATEQ TIME LOG 

DISTRICT Eastern ! ^ . SUBJECT Kca<Ufl/Ui*i 

SCHCOL teUxtn STATE § 0$ SCHOOL # OZ DATE WW NO. OF STUOENTS * 

TEACHES TfoudLlgV^ DISTRICT"^ TEACHER IWPGSWE t ?t&m_J*S_ 



The first reading /language arts activity begins at 8:46 when the 
whole class begins reading groups and seatwork. Lisa describes this 
activity and records the beginning time. Those entries are recorded 
below. 



(A) 



(B) 



(C) 



ACTIVITY 



BEGINNING 
TIME 



ENOIKG 
TIME 



Tll£ IN 
MINUTES 



Reading yosJfS 



3 



ERIC 
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When the first activity ends # Lisa records the ending time and finds 
the time in minutes. These entries are circled below. After recess # 
when the second reading/language arts activity begins, Lisa describes 
the activity and records the beginning time. These entries are circled 
below. 



(A) (B) (C) 



ACTIVITY 


BEG 1 MING 
TIME 


00 IKS 
TIME 


time in < 

MINUTES 


1 










2 










3 













At the end of this activity, Lisa records the ending time. Since 
not all of the class was assigned to reading during this period* Lisa 
must adjust the time in minutes. She first subtracts the beginning 
time from the ending time (11*14 - 10:30) to get 44 minutes. Then # 
since about half of the students were assigned to reading, she mul- 
tiplies % x 44 minutes » 22 minutes and records this in the last 
column. When spelling begins, Lisa describes the activity and records 
the beginning time. These entries are circled below. At the end of 
the activity, Lisa records the ending time and the time in minutes. 
These entries are enclosed in triangles below. 







(A) 


(B) 


(O 


ACTIVITY 


BEGINNING 
TIME 


END IKS 
TIME 


TIME IN 
MINUTES 


1 






10:01 




2 




\o: 30 






3 










4 
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There Is only one reading/language arts activity In the afternoon. 
This activity Involves multiple assignments In language arts and math. 
Lisa describes the activity and records the beginning time. These 
entries are circled below. Since there are multiple assignments! how- 
ever, the ending time Is different for different students, so Lisa 
records "varies" a s shown below. To find the time in minutes, she 
estimates the time needed by an average student to complete the lan- 
guage assignment (15 minutes). These entries are enclosed In triangles 
below. 







(A) 


(B) 


(C) 


ACTIVITY 


BEGINNING 
TltiE 


ENDING 
TIME 


TIKE IN 
MINUTES 


1 


Reading groups 




IO:0| 


IS 


2 




JO: 2>0 






3 




Ii:i4 




3o 


4 











Lisa finds the total allocated time for reading/language arts by 
adding the time In minutes for each activity. Add the last column and 
check to see if it matches Lisa f s answer of 142 minutes* 

Complete another Allocated Time Log for Lisa f s classroom for math and 
check your answers with those on the answer key (1T41). 




7/17/80 



*H. Scheduling (AO minutes) 



ER?C 



Rationale : Teachers need a plan for data collection. 



Materials 



1H44--Alternative Initial 

Observation Procedures 
1H45--Observation Schedule 
(a-b) 

1H46 — Pre-Observation Form 
(a-b) 

1T47 — Forms Used in 

Information Collection 



Alternative Strategies 
1, 



Strategy 

Review the rationale for systematic 
and repetitive classroom observations. 

Describe the alternative strategies 
for data collection and the advantages 
and disadvantages of each strategy. 
Select a strategy and have each 
teacher develop an observation sched- 
ule for his/her classroom. Then 
describe the rationale for the Pre- 
Observation Form and explain how it 
is completed. 



2, 



Make a videotape of the classroom during the scheduled observation 
time and have the teacher complete the Engagement Rate Form for 
his/her own classroom. The teacher and another observer should 
code the first tape to check for teacher bias (f"*e Note D.l.b.). 

In order to account for individual differences in coding, you 
may want to have different observers in each classroom on 
different days. 



Rationale for systematic and repetitive scheduling of observation 
(5 minutes) 

a< Accurate picture of variation in classroom throughout year 

b. Repetitive observations — means of evaluating, strategy for in- 
creasing or maintaining levels of student engaged time 

Alternative initial observation strategies (15 minutes) 

a. Rationale 

(1) Different situations require different strategies for 
data collection — e.g., teachers with more than one class 
in a subject area may wish to observe only one or may 
wish to keep separate records for two or more 

(2) Each strategy has advantages and disadvantages 

b. Descriptions (1H44) 

(1) 1-2 days of observation for reading, language arts, and math 

(a) Observe 1/3 of the allocated time for each subject at 
the beginning, middle, and end of period on 1-2 days 

1.190 
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(2) 1-2 dsys of observation for reading and math and 1 day 
for language srts 

(a) Observe 1/3 of si located time for reading and msth 
at beglnnlng t middle! and end of period on 1-2 days 

(b) Observe 1/3 of allocated time for language arts 
during the middle of the period on 1 day 

(3) Shorter observations on 1-2 days for reading and 1 day 
for language arta 

(a) Observe 15 minutes of reading and math at the 
beglnnlng t middle! and end of the allocated time on 
1-2 days * 

(b) Obaerve 15 minutes of language arts at middle of 
allocated time on 1 day 

(4) One day of observation for each subject 

(a) Observe entire allocated time on one day for each 
subject 

Advantages and disadvantages of each strategy 

(1) First strategy — 1-2 days observing readlng t language 
arts, and math 

(a) Advantages 

(1) Better sampling of language arts activities 

(11) 1/3-2/3 of period Is observed In each subject 
over 1-2 daya 

(b) Disadvantages 

(1) Time and scheduling requirements 

(2) Second strategy-- 1-2 days observing reading and math! 
and 1 day observing language arts 

(a) Advantages 

(i) 1/3-2/3 of period Is observed for reading and 
math over 1-2 days 

(11) Fever observations needed than first strategy 

(b) Disadvantages 

(1) Less language arts time and fewer types of 
language arts activities are observed 

(3) Third strategy — shorter observations on 1-2 days for 
reading and math and 1 day for language arts 

(a) Advantages 

(l) Less time Is required for each observation but 
one or two days are still sampled 
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(b) Disadvantages 

(l) Whole period la not observed 

(11) Less language arts time and fewer typea of 
languaga arts actlvltlea are obaervad 

(4) Fourth strategy— 1 day of observation for each subject 

(a) Advantagea 

(l) Eaaler to achedule 

(11) Easier to ace claasroom'a patterns when entire 
period Is observed for one day 

(ill) Better aamplinga of language arts 

(b) Dlsadvantagea 

(l) Limited to one day, which may not be typical 

(ll) Variation between daya and typea of actlvltlea 
will not ahow 

d. Selection of strategy 

Scheduling obaervatlona ( 1H45) (20 mlnutea) 

a. Datea 

(1) Typical days 

(a) Not flrat week of school, shortened days, first 
day before or after a long vacation 

(b) Repreaentatlve of varlatlona in actlvltlea (e.g. , 
amount of time apent on reading/language arta or 
math dlffera or apeclflc aapecta of these aubjecta 
are taught on different daya) 

(2) Obaervatlon days do not need to be conaecutlve 

(3) 1-2 days per aubject area depending on aeiected atrategy 

b. Timea 

(1) Fart of period 

(2) Duration of obaervatlon 

(3) Frequency of obaervatlon 

c. Obaerver 

(1) Muat have demonatrated maatery 

(2) Another claaaroom teacher, reading or math apeclallat 

or coordinator, principal, district curriculum coordinator, 
substitute, or student teacher 

(3) Different people can make obaervatlons for a aubject on 
different days 

t(4) Teacher 1 a ratlnga of own atudenta 1 engagement correlates 
with stcdent aptitude, not with obaerver 1 a ratlnga of 
engagement (See Note D.l*b*) 
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d ( Pre-Observation Form (1H46 



(1) Rationale -* more nccurnto information in collected If 
observer understands the schedule and planned activities 

(2) Teacher completes prior to observation day and discusses 
it with observer, if possible 

(3) Description 

(a) Number of students assigned to each activity on 
the front 

(b) Description of assigned activities on back 

(c) Attach assigned worksheets, if possible 
4. Review of forms (1T47) 



21 



14 
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Materials 
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Alternate Initial Observation Procedures 



11144 




I. 



Sub iec t 


# Days of 
Observations 


Length of 
Observation 


Part of 
Period 


Observation 
Intervals 


Reading 


1-2 


1/3 of 

allocated 

time 


beginning 

middle 

end 


1-2 minutes 


Language 
Arcs 


1-2 


1/3 of 

allocated 

time 


beginning 

middle 

end 


Math 


1-2 


1/3 of 

allocated 

time 


beginning 

middle 

end 


1-2 minutes 



II. 




Subject 


f Days of 
Observation 


Length of 
Observation 


Part of 
Period 


Observation 
Intervals 


Head ing 


1-2 


1/3 of 

allocated 

time 


beginning 

middle 

end 


1-2 minutes 


Language 
Arts 


1 


1/3 of allo- 
cated time 


middle 


Math 


1-2 


1/3 of allo- 
cated time 


beginning 

middle 

end 


1-2 minutes 



III. 



Subiect 


Days of 
Observation 


Length of 
Observation 


Part of 
Period 


Observation 
Intervals 


Reading 


1-2 


15 minutes 


beginning 

middle 

end 


1 minute 

■ 


Language 
Arts 


1 


15 minutes 


middle 


Math 


1-2 


15 minutes 


beginning 

middle 

end 


1 minute 



9 
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IV. 




Subject 


# Days of 
Observation 


Length of 
Observation 


Part of 
Period 


Observation 
Intervals 


Reading 


1 


entire allo- 
cated time 


entire allo- 
cated time 


1-3 minutes 

- — 


Language 
Arts 


1 


entire allo- 
cated time 


entire allo- 
cated time 


Math 


1 


entire allo- 
cated time 


entire alio* 
cated time 


1-3 minutes 
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CLASSROOM OBSERVATION SCHEDULE* 



Reading 



Date 


Time 


Part of Period 


Observer 



















































Language Arts (e.g ( , spelling, writing, grammar) 



Subject 


Date 


Time 


Observer 



















































Math 



Date 


Time 


Part of Period 


Observer 



















































*To be completed by each teacher for his/her classroom to provide a record 
of when his/her class will be observed* 
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OBSERVER'S SCHEDULE * 



lH45b 



Classroom To Be 


Subject To 

DC UDElCL VCU 


Date 


Arrival Time 












, r-^ -r-r 
























































— ■ • - 
































, .J 












— , — , — , ■ — 


































, „ ^ 






^ . m — m 








^ . . , 



*To be completed by each observer to provide a record of where and 
when he/she is to observe. 
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Pre-Observation Form 



lH46a 



Teacher 

Observer 

Time Interval 

No. of Students Present 



Subject 

Observation Date 

Circle beginning 
Part of Period middle 
end 



Record number of students assigned to each category during the observation period. 



Times 


Reading/ 
Language Arts 


Math 


Other Subjects 
Specify : 


Pull- 
Out 


Out of Room 
Specify: 






lays 


21 < 


) 
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Pre-Observation Form (cont'd) 



lHA6b 



Briefly describe assignments for each subject and free-time activities 
(attach worksheets If possible). 

Reading 

Group 1 



Group 2 



Group 3 



Language Arts 



Math 



2'2n 

Other 
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FORMS USED IN INFORMATION COLLECTION 



Form 

Pre-Observation Form 
Allocated Tine Log 

Engagement Rate Fora 



Completed By 
Classroom Teacher 

Classroom Teacher 
Observer 



Time of Completion 

Prior to observation 
(only for observation days) 



On observation days for 
all reading, language arts, 
and math instruction 



On observation days during 
reading, language arts, 
and math instruction 
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FORMS 



The following forms need to be reproduced In multiple copies for each 
participant. You may wish to color code these forms in order to help 
distinguish them. Each participant will need: 

•Pre-Observation Form 

3- 9 forms needed for initial observation cycle 
1-3 forms needed for subsequent observations 

•Allocated Time Log 

4- 6 forms needed for training activities in Topic G 
3-6 forms needed for initial observation cycle 

1- 2 forms needed for subsequent observations 

•Engagement Rate Form 

1 form needed for training activities in Topic D 

2- 4 forms needed for training activities in Topic 

1- 3 forms needed for training activities in Topic 
of mastery) 

6-9 forms needed for initial observation cycle 

2- 6 forms needed for subsequent cycles 

Masters for these forms are included in the following pages. Also included 
is an Alternate Engagement Rate Form which provides space for recording the 
time of observation in two places: with reading/language arts or with math. 



E (observer training) 
F (demonstration 
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7/24/80 Pre-Observatlon Form 
Teacher Subject 



Observer Observation Date 

Time Interval 

No. of Students Present 



Time Interval Circle beginning 

Part of Period middle 
end 



Record number of students assigned to each category during the observation period. 



Times 


Reading/ 
Language Arts 


Math 


Other Subjects 
Specify: 


Pull- 
Out 


Out of Room 
Specify; 


• 
• 

ERIC 
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Pre-Observation Form (cont'd) 

Briefly describe assignments for each subject and free-time activities 
(attach worksheets if possible)* 

Reading 

Group 1 



Group 2 



Group 3 



Language Arts 



Math 



Other 

1*203- 
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State 



District, 

School 

Teacher 



ALLOCATED TIME LOG 



Subject 



State # 



School # 



Date 



District # 



Teacher # 



Grade 



No. of Students 
Present 







(A) 


(B) 


(C) 


Acti vi ty 


Beginning 
time 


Ending 
Time 


Time in 
Minutes 
(B) - (A) 


1 










2 










3 










4 










5 










6 










TOTAL 





DIRECTIONS 

1, Fill out the information at the top of the page, including the date, subject 
(reading/language arts or math), and number of students present. 

2, Whenever students are assigned to the subject area, record a description of the 
activity (e.g., reading groups, spelling, math drill) and the beginning time (A) 

3, Record the ending time when assignments change (e.g., the activity is completed) 
Find the time spent on the activity in minutes (C) by subtracting beginning time 
from ending time (B - A), 

•If students are working on more than one subject area during an activity 
(e.g., math or reading seatwork) , put "varies" in as the ending time (B) 
and for time in minutes (C), put an estimate of the time an average 
student spends completing the activity in the subject area. 

•If part of the class is working in one subject area while the rest of 
the class works in another subject area, adjust the time in minutes by 
multiplying by the approximate fraction of the class in the appropriate 
subject area. For example, if about half the class is working on reading 
and about half on science during a 60-minute activity, the time in 
minutes is 1/2 * 60 - 30 minutes, 

4, Add the last column to get the total allocated time for the subject area. 
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<. TAT c 1 ENGAGEMENT RATE FORM 

STftit . part Qf 

DISTRICT 'State * School # Date Grade Class 
SCH00L | jr.. ^served 

0EACHER jOlstHct* Teacher* Coder* fresent Mid! 

COOER , End 


Time 


1 


1! 


3 




5 




7 


8 


y 




















< 

LJ 

| 

CD 

§ 

LJ 


Assigned 
















i 




Management/ 
Transition 




















Socializing 




















Discipline 




















Unoccupied/ 
Observing 




















Out of Room 




















Total 
Unengaged 




















Engaged 1 




















CO 

<-> 
< 

LJ 

' 1 


Assigned 




















Management/ 
Transition 




















Socializing 





















discipline 




















Jnoccupied/ 
Dbserving 




















3ut of Room 




















Total 
Unengaged 




















tngaged 1 






















Other 
Assiqned 




















Pull-Out 
Assigned 






— 














f Students 
Present 2 




















Notes: (Engegtd • Assigned - Total Unengegod 2 To be used onljf If nuabtr Of itudents present changes during period of observation 

^ B DIRECTIONS 

1* Enter the clessroo* *boi*t 5 alnutes before Observation* *U1 i>eg1n. Fill out the fnfomtttlon In the upper left comer of the 
form; record the dote, great, nuootr of students present Utt*nd«nc«). end pert of cliSi abuiwi (chick on*; beginning, middle, 
or end) et upper right* 

O 2 Record obseryetlo* dete (nu*#r of students esslgntd, not ongtged. npfcer of studeflti «*gegtd). 
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Observer's comments: 



Time 


10 


11 


12 




u 


15 


' Total 


Engagement 
Rate 
















Assigned 
















Engaged 


in 


nan ay ewe n t/ 

Transition 
















ass i gneo 


< 

UJ 


Socializing 






■ 












a 


Discipline 


















MG/LAI 


Jnoccupied/ 
jbservi no 


















IEADI1 


Out of Root* 




















Total 
Unengaged 




















Engaged! 




















Assigned 




















Management/ 
Transition 
















• 




Socializing 
















Enpaged 


ftTICS 


discipline 
















Assigned 


IATIIEM; 


Jnoccupied/ 
observing 




















3ut of Room 




















Total 
Unengaged 




















Engaged 1 




















bther 
Assigned 




















Pull Out 

Assiqned 




















i Students 
Present 
















V,-. '. ' • •••• -. • ' •-• '-■ ' 



0 

ERIC 



Add acros* each row to find the total* [f more than one Engagement Rate Form wai used for a tubject area on 
that day, add the totals for all forms and record these numbers on the Ust form used* 

Calculate e*oagt*ent rate* for the day' by dividing the Total lho*er of Studenti Cnoaoed by the Total Hw**r of Stvrfe*t« 
teilgned for each subject area* 



Crgagetnent Rat* for AtadlnoVLanOjUaOje *rti 
Ir^aoentnt t*U for fethpitfci £> 9 Q 



T o Ml St u ^nti Cnn* q H <n_ft^ad1n^/ t afwwiqe hrj\ 
Tout Studenti Asitaned to RcaoTftQ/lanquaoe Arti 

Total S tude nti Cigaoed In Math 
TolaTJtudenti EiTfSH to Hath 
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STATE 

DISTRICT _ 

OOL 

CHER _ 
COOER 




I 



State 4 



ALTERNATE ENGAGEMENT RATE FORM 
School I Oate 



Grade 



01 strict I 



Teacher It 



Coder # 



t Students 
Present 



Part of 
Class 
Observed 
Bey . _ 
Mid. " 
End 



Time 


1 


2 


3 


4 


5 


6 


7 


5 1 




















<c 

XjJ 
O 

3 
1 

O 

1-^ 
O 

<C 
XjJ 


Assigned 




















Management/ 
Transition 




















Socializing 




















Discipline 




















Unoccupied/ 
Observinq 




















Out of Room 




















Total 
Unengaged 




















Engaged 1 




















Time 






















Assigned 






















Management/ 
Transition 




















Socializing 





















MATHEMATICS 


j 

Disci pi ine 




















Unoccupied/ 
Observing 
















1 — i 




Out of Room 






! 1 














Total 
Unengaged 






















Engaged 1 






















Other 
^ssianed 




















Pull -Out 
Assigned 




















I Students 
Present 2 





















ERIC 



betes: 'Engtged * Assigned - Totel Unengeged *To be used only If number of stents present chenges during period of abservetlon 

K titer t*e cleisroo* ebout S minutes before Observations begin. Fill out the Information In the uw UU comer of the 
for*; record tne dete, aredt. number of students present (ettendtnee). end p4rt of cUsfttfMrcved (check on*: beginning, alddle, 
or end) et upper right. £ £7 

2 Pecord observetlon tftte (m*btr of students esslgned, not engeged. ftUJfeer of students tngeoed). 
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Observer's Comments: 



Discipline 



lima 



Assigned 



Management/ 
Transition' 



Socializing 



_LL 



Unoccupied/ 
Observing 



Out of Rocx 



Tothl 
Unengaged 



Engaged 1 



12 



12. 



14 



15 



Total 



Eng^Muetit 

W- 



Eng aged 
Assigned 



ERIC 



Time 



Assigned 



Management/ 
ransi tion 



Socializing 



jiscipline 



Jnoccupied/ 
Dbserving 



Dut of Room 



Total 
Unengaged 



Engaged 1 



JtHer 

Assigned 



Pull Out 

Assigned 



* Students 
Present 



Engaged 
Assigned 



3 + Add across each row to find the total. If more than one Engagement Rate form was used for a subject area on 
that day. add the totals for all forms and record these numbers on the last form used. 

4. Calculate en9#g*»*ot rates for the day by dividing the Total Nifitor Of Students tnoaoed hy the ToUl HwmVr of Student* 
Asstqntd for etch Subject *r?i. 



F^wnt Rat* for Aeadl^/Lanquane Arts 
traao***nt **U for HithWtlCS 



23n 



T otal SM »nt stnq »g»< l In R*adlnq/ l* " ay* je Arts 
ToliTTt^^tsTFs i ooed to ReaoTna/LahOuage Art* 

Total Students twgetMw Hath 
ToUt Students Assigned to Hath 

1.20G 
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APPENDIX A 



ALTERNATIVE AGENDAS TOR INFORMATION COLLECTION 

Included in this appendix are two alternative ways to organize the 
information collection session(s). Alternative Agenda A differs from the 
standard agenda by presenting definitions of terms as they are needed. 
Alternative Agenda B organizes information collection activities into a 
series of four 2-3 hour meetings. Alternative Agenda C illustrates one 
way of breaking up videotape training by interspersing other topics. 

Alternative Agenda A 

Pre-Observation Meeting(s) (6-9 hours) 
•Agenda (Topic A"5 minutes) 

•Instructional Improvement Cycle (Topic B — 5 minutes) 
•Rationale for Focus on Time (Topics C.l and C.2 — 5 minutes) 
•Engagement Rate Form (Topics C.3.b and D — 110-120 minutes) 
•Observer Training (Topic E — 1-3 hours) 
•Demonstration of Mastery (Topic F— 1-2 hours) 
•Allocated Time Log (Topics C.3.a and G—55-60 minutes) 
•Scheduling (Topic H — 40 minutes) 

Alternative Agenda B 

Meeting #1 (about 2^ hours) 

•Agenda (Topic A — 5 minutes) 

•Instructional Improvement Cycle (Topic B — 5 minutes) 

•Rationale for Focus on Time (Topic C — 15-25 minutes) 

•Engagement Rate Form (Topic D — 100^110 minutes) 

•Summary (Activities completed; activities to be done in next 
meeting — 5 minutes) 
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Meeting #2 (about 1^-3^ hours) 

•Review (Activities completed in previous meeting; Topic D*2-~ 
15 minutes) 

•Observer Training on the Engagement Rate Form (Topics E ( l-E ( 2.c — 
1-2 hours) 

•Summary (Activities completed; activities to be done in next 
meeting— 10 minutes) 

Meeting #3 (about 1*5-2*5 hours) 

•Review (Activities already completed; Topic E.2.d — 20 minutes) 

•Demonstration of Mastery of the Engagement Rate Form (Topic F — 
1-2 hours) 

•Summary (Activities completed; activities to be done in next 
meeting — 10 minutes) 

M eeting #4 (about 2 hours) 

•Agenda (Activities to be done— 5 minutes) 
•Allocated Time Log (Topic G — 55-60 minuter) 
•Scheduling (Topic H — AO minutes) 

•Summary (Activities completed so far, collecting information in 
classrooms, activities for next meeting — 10 minutes) 

Alternative Agenda C (5^-9 hours) 

•Agenda (Topic A— 5 minutes) 

•Instructional Improvement Cycle (Topic B— 3 minutes) 

•Rationale for Focus on Time (Topic C — 15-25 minutes) 

•Engagement Rate Form (Topic D — 100-110 minutes) 

•Observer Training (Topics E.l.a, E. l.b. (l)-(2)~ 30-90 minutes) 

•Allocated Time Log (Topic G — 55-60 minutes) 

•Observer Training (Topics E.l*b. (3), E. 2— 30-90 minutes) 

•Scheduling (Topic H — 40 minutes) 

•Demonstration of Mastery on the Engagement Rate Form (Topic F — 60-120 
minutes) 



2io 
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APPENDIX B 

SUPPLEMENTARY ACTIVITIES FOR TOPIC B~ 
PHASES OF THE INSTRUCTIONAL IMPROVEMENT CYCLE 
(30 minutes) 




Rationale, Leaders may wish to provide additional details about 
applying the instructional Improvement cycle to student engaged time 
either as a part of orientation or as a supplement to Topic B. 
Actually seeing instruments, graphs, etc., may enable participants 
to more clearly visualize each phase of the process. 



Materials 

1T1 — Instructional 

Improvement Cycle 



BT2 — Blank Allocated 

Time Log 
BT3 — Completed Allocated 

Time Log 



BT4 — Blank Engagement 
(a-b)Rate Form 
BV5— Classroom Scan 

for Engagement 

Rate Form 
BT6 — Completed 
(a-b) Engagement Rate 

Form 

BT7 — Completed Time 
Nomograph 



Strategy 

Name the phases of the instructional 
Improvement cycle. 

Discuss the reasons for collecting 
information on the selected aspects 
of time. 

Provide a rationale for examining 
allocated time.' Show a sample blank 
log to Illustrate how Information is 
collected on this Instrument. Do not 
go into detail about how to complete 
the log as more detailed descriptions 
will be provided later. You may also 
wish to show a completed log. 

Provide a rationale for examining 
engagement rates. Briefly describe 
the observation instrument. Then view 
the videotape, emphasizing that each 
individual student would be observed. 
Then show how this span is recorded 
in the first column of the ccmpleted 
form. 

Provide a brief description of the 
nomograph, emphasizing its purpose as 
a device for quickly calculating 
student engaged time* 



# 
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Materials 

BT8— Third Grade 
Reading Graph 

BT9 — Types of 
Graphs 



Strategy 

Provide a brief description of the 
research base. Show a sample graph 
which indicates a classroom's engaged 
time. Emphasize that different graphs 
indicate different patterns. Explain 
that based on these comparisons each 
teacher determines what kind and how 
much of a change are needed in 
student engaged time and the aspects 
of engaged time that need to be 
modified. 

Describe the activities in selection 
and preparation and types of possible 
modifications. Then describe 
implementation and monitoring along 
with the iterative nature of the 
cycle. 



Alternative Strateg y 

Show only the completed instruments, not the blank ones. 



BH10 — Selected Program 
(a-b) Modifications 




1. 



2. 



Phases of instructional improvement cycle ^1T^2 (3 min.) 

a. Collect information 

b. Compare collected information with research and identify desired 
changes 

c. Select program modif ication(s) and prepare implementation plan 

d. Implement and monitor modifications 

e. Repeat cycle again 
Information Collection (16 mins.) 
a. Purpose 

(1) Collect information from each classroom so each teacher can 
make own decisions regarding program modifications 

(2) Not standard prescription for all teachers, since teachers 
and classes differ 



ERLC 
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Aspects of time related to achievement 

(1) Student needs an opportunity to learn content 

(a) Amount of time provided for a subject (allocated 
time) 

(2) Providing time is not sufficient if student is not 
working on learning the content 

(a) Rate at which students are engaged in learning 
during allocated time (engagement rate) 

Instruments 

(1) Log (See Topic G) 

(a) Log appropriate way for collecting information on 
allocated time 

(b) Brief description of blank log (optional) 

(1) Record actual beginning and ending times for 
each activity 

(ii) Allocated time (time in minutes) recorded for 
each activity 

(c) Brief description of completed log (EH) 

(i) Reading groups from 8:51 to 10:01 — 82 minutes 

(ii) Reading groups and language seatwork from 
10:30 to 10:57—27 minutes 

(iii) Spelling from 12:59 to 1:16—17 minutes 

(iv) Sustained silent reading from 2:30 to 2:50 — 
20 minutes 

(2) Observation Instrument (See Topic D) 

(a) Observation appropriate for collecting information 
on engagement rate 

(b) Brief description of blank form (BT4) 

(i) Record number of students assigned to a subject 
and count the number of students unengaged 

(ii) Subtract total unengaged from number assigned 
to determine number engaged 

(iii) Usually 15 observations made each day for 1-2 

days at beginning, middle* and end of period for 
each subject 

(iv) Length of period determines the frequency of the 
observations 

(v) Engagement rate figured in last column on the 
second side by dividing engaged by assigned 



9 
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(c) Classroom situation during which observation might 
be made (BV£) 

(1) Camera scans middle of third grade reading/ 
language arts class student by student to 
determine number of unengaged students In each 
category 

(ii) Observer notes unengaged students during first 
observation 

(d) Brief description of completed form ( BT6 ^ as it 
relates to video (BJ£i) 

(i) Identification Information at the top of the 
form 

(11) First column data from video scan - 16 students 
assigned and 1 student unengaged; so 15 
students are engaged 

(111) 14 other observations made In this classroom 

at one minute intervals Immediately afterwards 

(lv) Total each unengaged category on back of form 
to assist with selection of strategies In 
Phase III 

(v) 75% engagement rate determined by dividing 
total engaged (180) by total assigned (240) 

d. Preparing data for comparison with research findings 

(1) Description of nomograph (£XZ) ~ device to help you find 
the number to compare with research findings 

(a) Located allocated time (134 minutes) and engagement 
rate (75%) on scale 

(b) Draw line through these points to determine student 
engaged time (100 minutes) 

(2) Definition of student engaged time - amount of time 
students are actively engaged in a subject area 

3. Comparison and Identification (4 mlns*) 

a. Comparison with research 

(1) Research base - Stalllngs fit Kaskowitz Follow Through 
Evaluation Study (Appendix C) 

(2) Select and read appropriate graph ( BT8 ) 

(a) Explanation of graph 

(i) The relationship between student achievement 
(vertical axis) and student engaged time 
(horizontal axis) 

(li) Inverted u (n) means more student engaged time 
Is better up to a point; then it declines 



9 
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(b) Student engaged time from nomograph (100 min.) 
plotted on graph 

b. Identification of opportunities for Improvement 

(1) What kind of changes— Increase, decrease, stay the same 

(a) Tony Caslnl wishes to increase his time from LOO 
minutes 

(b) Teachers between L 1 3— 172 minutes may remain the 
same; teachers above 172 minutes may elect to 
decrease student engaged time 

(c) Different teachers may make different changes, as 
some graphs Indicate more Is not always better 
(BT9) 

(2) How much change 

(a) Tony wishes to increase from 100 minutes up to 
125 minutes 

(3) Identify aspect of student engaged time 

(a) Try to Increase allocated time from 134 to 139 
minutes 

(b) Try to Increase engagement rate from 75% to 90% 
4. Selection and preparation of strategies (4 mlns.) 

a. Selection of strategies 

(1) Review research strategies and generate additional 
strategies (EEJfl) 

(2) Select own strategy based on analysis of previously 
completed data 

(a) Tony's strategy for increasing allocated time based 
on weekly lesson plans - reduce time In art f music, 
social studies 

(b) Tony T s strategy for Increasing engagement rate 
selected on basis of completed Engagement Rate 
Forms 

(1) Provide multiple assignments to reduce number 
of students unoccupied/observing or socializing 

(11) Discipline students privately to reduce number 
of times class interrupted by discipline 

b. Preparation 

(1) Implementation planning 

(2) Planning for monitoring 
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5. Implementation and monitoring (3 minutes) 

a. Monitoring implementation if complex strategy is planned 

b. Tony informally monitors implementation of all 3 strategies 
for several weeks before collecting data again 

c. Repeat cycle throughout the year to see if strategy made 
expected change in student engaged time 



'38 
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MATERIALS 
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1T1 

BASIC SKILLS INSTRUCTIONAL IMPROVEMENT CYCLE 




STATE 

DISTRICT 
SCKOOLj 
TEACHER 



ALLOCATEO TIME LOG 



STATE # 
DISTRICTT 



SCHOOL #_ 
TEACHER » 



DATE_ 
GRAjE 



SUBJECT 

NO. OF STUDENTS 
PRESENT 



oo 
o 



ACTIVITY 


BEGINNING 
TIME 


ENDING 
TIME 


TIME IN 
MINUTES 


1 










2 










3 










4 










5 








i 
t 

I 


6 




i 

1 


i 


\ 

! 


TOTAL 


) j 



241 



242 



STATE Ajkoiic. 
DISTRICT 



SCHOOL Neu^"t>e.\yen 

TEACHE R ' 



STATE # 03 



DISTRICT £47 



ALLOCATED TIME LOG 

SCHOOL # O S DATE )o/s 
TEACHER *jyoS GRADE 3 



t ^ 



SUBJEC T RgjotAing /La.y\g. \ 

m. of studERTs^ *\ 



CO 

o 



PRESENT 16, 



.3 



:RJC 



ACTIVITY 


BEGINNING 
TIME 


EASING 
TIME 


TIME IN 
MINUTES 


1 






10:01 


70 


2 


"RftAjdiri^ ^ troops 
Unguoige. s>ecd"cuorK 


10 •. 30 


lo-sq 




3 






f'Ho 




4 


Su*V<x\r\eck &ilei\V reading 


<A'30 






5 










6 




i 


i 

! . 



TOT* 





/3 V 



S 

"O 

r— 

q 

m 



o 

B 



O 
CD 



241 
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BLANK ENGAGEMENT RATE FORM 
(Front of Form) 



BT4a 



ENGAGEMENT RATE FORK 

STATE i 

DISTRICT ' PART OF 
SCHOOL ! STATE # SCHOOL If DATE GRADE aASS 
TEACHES i OBSERVEU 
CODER ' H STUDENTS flea. 

! DISTRICT # TEACHER # CODER # PRESENT Mid. 

i End 




TIME 


1 


9 




4 


5 


6 


7 


8 






















E ARTS 


ASSIGNED 




















MANAGEMENT/ 
ItWwl 1 (UN 


































. 








DISCIPLINE 






















JNOGOJPIED/ 




















DUT OF ROOM 






















rorAi 




















3JGAGED 




















I 
1 


ASSIGNED 


















•IANAGEMENT/ 
TRANSITION 




















SOCIALIZING 




















JldUrUNt 




















JMCCUPIED/ 
OBSERVING 




















OUT CF ROOM 




















TOTAL 

JNENGAGED 




















ENGASED 






















OTHER 
ASSIGNED 




















PULL CUT 
ASSIGNED 




















KG. CF 

STUjE'JTS 
PRESENT 






i 
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BT4b 



BLANK ENGAGEMENT RATE FORM 
(Back of Form) 





TIME 


W 


-U 


12 


13 


14 


15 


TOTAL 


RATE 














CO 

1 

LU 

5 


ASSIGNED 
















ENGAGED 
ASSIbi<£C 


MANAGEMENT/ 
TRANSITION 
















SOCIALIZING 
















DISCIPLINE 
















UNOCCUPIED/ 
OBSERVING 
















OUT OF ROOM 
















TOTAL 
UNENGAGED 
















ENGAGED 
















1 


ASSIGNED 
















CfwAutU 


MANAGEMENT/ 
TRANSITION 
















i ASSIGNED > 


SOCIALIZING 
































UNOCCUPIED/ 
OBSERVING 
















OUT OF ROOM 
















TOTAL 
JNENGAGED 
















ENGAGED 


















OTHER 
ASSIGNED 


















3 ULL OUT 
ASSIGNED 
















# STIEEHTS 
=R£S£.NT 

















2*5 
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BV5 




BV5 is a videotape clip illustrating the scanning process used during 
classroom observations. 
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COMPLETED ENGAGEMENT RATE FORM 
(Front of Form) 



BT6a 



0 

:RIC 



STATE Aikoik 
DISTRICT EcisW 
SCHCGL^Sgjw 
TEACHER cZa^T 
CODER ttemcVin 



ENGAGEMENT RATE RHW 

- PART OF 
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COMPLETED ENGAGEMENT RATE FURM 
(Back of Form) 
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COMPLETED TIME NOMOGRAPH 
x Allocated Time = Student Engaged Time 
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Source: Stallings & Kaskowitz (1974) 
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TYPES OF GRAPHS 
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Selected Program Modifications 



Management/Transit ion 




In order to reduce the time children spend waiting for help, 
give students alternate assignments to complete when help is 
not immediately available. You may also assign a peer tutor, 
give each student a sign to raise for help, or use a sign-up 
sheet or the board for students to indicate that they need 
assistance. 



1»3 



Spend 50-75 percent of math class t ime on meaningful develop- 
mental activities and 25-50 percent on drill and practice. 
Developmental activities Include teacher demonstrations, 
teacher explanations, group discussions, work with manipula- 
tive materials, and laboratory activities. Individual 
pupil tasks such as assignments in textbooks, kits, dittos, 
or tapes are "drill and practice. 



Socializing 




• Increase teacher-student academic interactions . Ask students 
more questions . a * 

• During recitation, keep students "on their toes . T1/ 

• Move around the room regularly and systematically - 1 ' ^' 7 * ^ 



Discipline 




Let students know which behaviors are desired and which will 
not be tolerated. Expectations should be clearly stated in 
behavioral terms- Teach them the skills of good behavior. 1 

Give students specific feedback (both positive and negative) 
specifying what the student should be doing and/or what was 
undesirable about the misbehavior- 1 

Particularly for students of low socioeconomic status, have 
individual conferences with misbehaving students. 5 
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Unoccupied /Observing 





Project a positive altitud e abo u t academic work. Display 
work well done T 

Increase teacher-student academic interactions . The more 
often a student is involved in academic interaction with 
the teacher, the higher his/her engagement rate. 3 * 5 

Check students' work by looking at papers or listening to 
oral responses. Student answers stould be visible to the 
teacher. Nonperformers should be brought into the recita- 
tion. The teacher should circulate, checking performance 
during recitation. Unison responses with the teacher se- 
lectively listening for individual answers may be used. 3 ' 7 * 8 




9 
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Strategies to Increase Allocated Time 

Keep a log of how time is actually spent in each subject 
area each day. Use this information to try to increase the 
time available for reading and/or mathematics. 7 * 
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APPENDIX C 



SUPPLEMENT TO TOPIC C 
RATIONALE FOR FOCUS ON TIME 



This appendix consists of two parts. The first part provides 
suggestions for supplementary activities for Topic C (topic outline, 
materials, and notes), while the second part is a paper discussing 
"Research Findings on Time." 
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SUPPLEMENTARY ACTIVITIES FOR TOPIC C— 
RATIONALE FOR FOCUS ON TIME 
(60 minutes) 



Rationale . Some leaders may wish to provide additional details about 
research findings on time or about other measures of time or to 
provide activities Involving computations with different measures of 
time. Such activities are outlined here. These activities might 
replace those outlined In Topics C.3 and C.4. 



Materials 

"Calculators 
CT11 — Measures of Time 
CH12 — Estimate Your Time 



CH13 — Time Nomograph 
CH14 — Engagement Rate and 

Student Engaged Time 
CH15 — Calculating Student 

Engaged Time 
1T16 — Flow Chart for 

Computing Student 

Engaged Time* 
1H17—Tlme Definitions 

Worksheet* 
1T18— Answer Key for 1H17* 
1H19— Student Engaged 

Time Worksheet* 
1T20— Answer Key for 1H19* 

1H21 — Time Glossary; 
(a-b) Selected References* 



Strategy 

Show CT11 while discussing research 
on school year, attendance year, 
school day, and allocated time. Note 
the constraints each previous factor 
places on succeeding factors. The 
levels (state, district, building , 
teacher policy) Influencing each 
measure are discussed. Have partici- 
pants complete CH12 after discussing 
allocated time. 

Discuss engagement rate and student 
engaged time, noting research 
results and the factors that shape 
each. Show participants how to use 
the nomograph and the flow chart, 
and then have participants do CH14 
and CH15. Participants should work 
independently on 1H17 and 1H19. 



1H21 is provided to all as a summary 
or review. Discuss academic learning 
time as a composite measure Involving 
time, content, and success. Point 
out that the program will Include 
independent measures of each of these 
variables. 



*Included in Topic C. 
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Rationale for focus on time — Continued 



Al ternative Stra tefiies 

1- Session leaders should feel free to add to, substitute for, or 
eliminate some of the research findings. Appendix C provides 
additional information, a bibliography, and handout. 

2. The definition of terms may be presented first, together, followed 
by a summary of research, 

3, Leaders may wish to reproduce and hand out the paper in Appendix C 
or parts of that paper in lieu of presenting research results orally, 

4* Leaders may omit discussion of 3a-c, school year, attendance year, 
and school day, and CH12 . 

5, 1H21, Time Glossary, may be handed out early in the session. 

6. See the alternate agendas in Appendix A. 



3. Various measures of time have been studied: (CT11 ) (60 minutes) 
(See Appendix C) 

a- School year 

(1) First limit on amount of schooling 

(2) Define school year (number of days scheduled for s tudent attend- 
ance) — 1st limit on amount of schooling 

(3) Role of state mandates and funding policies in determining 

(4) Research findings on length of average school year: 173-183 days 

(5) Research findings on relation to student achievement vary — 
probably due to lack of control of other important variables, 
e,g»^ content covered, length of school day, time allocated to 
various "Subjects 

(6) Another reason for scarcity of findings on relation of student 
achievement to length of school year is lack of variance in 
length of school year 

b. Attendance year 

(1) Definition — number of days in year a student attends 

(2) Reduces school year — another limiting factor on amount of 
oppor tunity 

(3) Role of student, home, community, peers, and school in shaping 
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(4) Research findings 

(a) One study of Title I class shews attendance reducing 
school year an average of 45 days or approximately 
25%. 

(b) Philadelphia-Federal Reserve Bank Study 

(i) Better attendance, the more reading score increased 

(ii) Fewer unexcused absences, the more reading score 
increased 

School day 

(1) Definition — number of hoars per day students are in school 

(2) Another constraint on opportunity to learn 

(3) Role of state, district, union policy 

(4) Research findings — average school day: 5-6 hours 

Allocated time 

(1) Definition — time teachers set aside for instruction in a 
content area 

(a) Amount of time scheduled or planned for instruction 
is one measure 

(b) However, amount of time planned or scheduled is changed 
by spontaneous, unplanned events that cause variation 
in day-to-day opportunity to learn. Records of when 
instruction actually begins and ends verify this 

(2) Again a limit on opportunity to learn 

(3) Role of Strict, building, and teacher 

(a) Wide teacher- to- teacher variations 

(e.g., 2nd grade math 30 min* - 59 min. 

2nd grade reading 34 min. ~ 127 min.) 

(b) Shows impact of teacher on student opportunity and 
achievement 

(4) Research 

(a) BTES Phases II and Ill—allocated time positively 
related to student achievement 
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(b) BTES Phase II findings on allocated time always 
reported for a specific setting (size of group, type 
of supervision [teacher, aide. Independent work]) 

(i) Time allocated to math for total group instruc- 
tion by teacher at 5th grade level positively 
related to student achievement in math 

(c) Increasing time (alone) does not necessarily increase 
achievement 

(i) What is covered — also important 
(ii) May be possible to allocate too much time 
Worksheet (CH12) 

(1) Estimate total allocated time 

(2) Estimate attendance during total allocated time (Use 
Principal's average daily attendance figure) 

(3) Awareness of total amount of time available 

(4) Year long implication of minor change in daily allocated 
time 

Engagement rate 

(1) Introduction 

(a) 175 hours of instruction in math provided 

(b) Student in attendance 170 of those hours 

(c) Student not apt to be attending 100% of time because 
of talking, daydreaming, socializing, etc. 

(d) Thus, another measure for rate of engagement is 
introduced 

(2) Definition 

(a) The percent of the allocated time that a class is 
perceived to be actively working, or engaged in, 
learning 

(b) Or, another measure of engagement rate is the percent 
of students engaged in instruction at any given moment 
of a class 

(3) Influences on engagement rate 

(a) Student — at ten tiveness 

(b) Teacher — management procedures 

(c) Building — interruptions (e#g# , intercom) 

(d) District — schedule of specials and pullouts 



1,235 



(4) Research findings 

(a) Averages: 60-80% 

(b) Variations: 50-90% 

(5) Engagement rates related to achievement — California 
Beginning Teacher Evaluation Study found students with 
higher engagement rates learn more 

(6) Also, measures involving engagement rate are related to 
achievement, particularly a measure called student engaged 
time — to be defined shortly 

(7) Worksheet examples on engagement rate (CH14) 

(a) Engagement rate = nun ^ er en S a S et * 

number assigned 

(b) Completion of worksheet 

(c) engagement Rate Form involves similar 
computations 

Student engaged time 

(1) Definition 

($) amount of time a student is actively engaged in 
attending to academic instruction or tasks 

(b) Productive time - allocated time x engagement rate 

(2) Research 

(a) Some studies have found stronger relationships between 
productive time and achievement than between allocated 
time and achievement (Fisher, Marliave, Filby, 1975). 

(b) Time alone is not strongest indicator — how time is 
spent is also important. 



t(c) Follow Through Classroom Observation Evaluation: 
1972-1973 by Stallings and Kaskowitz 

(i) Time child involved in reading or math 
highly and positively correlated with math 
and reading achievement 

(ii) Tijne measure used in instructional improve- 
ment approach is student engaged time 

(iii) Data used for comparison in Phase Two are 
from the Stallings & Kaskowitz Follow Through 
Study 
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(3) Use of nomograph (CH13) 

(a) Purpose 

(i) Tool for multiplying 

(ii) Can use to estimate answer 

(iii) Can use calculator instead 

(iv) Can be used to estimate/ check work on 
calculator 

(b) Procedures 

(1) Need straightedge— ruler or sheet of paper 

(ii) Locate allocated time on allocated time scale 

(iii) Locate engagement rate on engagement rate 
scale 

(iv) Place straightedge on point for allocated time 
and for engagement rate 

(v) Point where straightedge crosses student 
engaged time scale is student engaged time 

(4) Example with nomograph (or participants may use 
calculator) 

(a) Allocated time = 120 min. 

(i) Locate on allocated time scale 

(b) Engagement rate ■ 80% 

(i) Locate on engagement rate scale 

(c) Place straightedge along those two points 

(d) Reading student engaged time— approximately 96 
minutes 

(5) Worksheet examples on student engaged time f CHIA) 

(a) Student engaged time = allocated time * engagement 
rate 

(b) Calculating allocated time, engagement rate, and 
student engaged time ( CH15 ) 

(6) Worksheets ( 1H17 . 1T18 . 1H19 . 1T20) 

(7) For summary or reviaw (1 H2 1) 
Academic learning time 

(l) Term used widely in the publishings of the California 
Beginning Teacher Evaluation Study 



1,237 

2Gn 



7/15/80 




(2) Definition — amount of time a student spends attending 
to academic tasks while performing with a high rate of 
success 

(3) Research 

(a) The more academic learning time a student 
accumulates! the higher his/her achievement 

(b) High correlation with achievement test scores 

(4) In this program, time and instructional overlap 
are studied separately 
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Materials 

In addition to the materials Included here, the following materials 
from Topic C are needed: 

1T16 Flow Chart for Computing Student Engaged 
Time 

1H17 Time Definitions 

1T18 Answer Key for 1H17 

1H19 Student Engaged Time 

1T20 Answer Key for 1H19 

1H21 Time Glossary; Selected References 
(a»b) 



• 
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ESTIMATE YOUR TIIfTC 




CU12 



1. Record the number of days in your school year . 



To approximate the number of days in your average student attendance year , 
multiply the number of days in your school year by your school's percent 
of average daily attendance. 




Record the number of hours in your students 1 school day. 



Record the number of minutes per day you normally allocate for each area: 
(1) Read ing/ Language Arts (2) Math 

2, Find the total amount of time you allocate over one school year to: 



hours allocated 
days in school year x to subject in 

school day 



Reading/Language 
Arts 

Math 



x 
x 



Find the total amount of time a student is likely to be present for 
instruction over a year in: 



days in student 
attendance year 



hours allocated 
x to subject in 
school day 



Read ing / Language 
Arts 

Math 




x 
x 



Write the letter of the definition beside the corresponding aspect of 
time. 



School year 
School day 
Attendance year 
Allocated time 



a. Number of hours in a day that 
students spend in a school. 

b. Number of days tn the school year 
that an average student actually 
attends school. 

c. Number of days during which schools 
are open to students. 



P f ? * v * D (v 



d. 



Number of minutes in the teaching 
day available for instruction in 
a specific content area. 
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ffg^agement Rate 



90- > 



80.. 



70-, 



60^ . 




50-. 



40-* 




ERLC * 



TIME NOMOGRAPH 
Allocated Time 
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ENGAGEMENT RATE A1ID STUDEIIT ENGAGED TIME. 

n _. . ^ 



CH1A 



'((j Definition Match 

Student engaged Time 



Engagement Rate 
Allocated Tine 



Percent of assigned students engaged 
for a specific time period. 

b. UuiTiber of minutes spent on instruction 
in a subject area. 

c. dumber of minutes during which students 
actually do work related to a specific 
content area (i*>e., student is on-task) . 





2, 



Calculations for New Delpen's Fourth Grade 

On September 20th Jim Heindrick's fourth grade spelling class was observed 
once every minute for eight minutes. All 25 students present were assigne 
to a group spelling lesson, A record of five of the observations is shown 



below. 



Time 


10:31 


10:32 


10:33 


10:34 


10:35 


if unengaged students 


15 


2 


5 


8 


5 


// engaged students 


10 


23 


20 


17 


20 



It 



Use your calculator to find the engagement rate at: 



num ber en gaged 

engagement rate = r — 7 

6 6 number assigned 



40% 10:32 ~ = _ 




20 

!2i33 § = 



10:34 



10:35 



Student Engaged Time = Allocated Time x Engagement Rate 



i-'inci t\\o student engaged time 0 n e*n'h daV, Urite your snswer to the nonrt^t minute 

3, Cn September 20th, the average engagement rate for Jim's class 
was 78%, If his class was 60 minutes long, what was the 

student engaged time? (Use the Nomograph to Iielp you.) 



On September 21st, Jim's math class was 60 minutes long and 
the average engagement rate was 85%, What wss his class' 

student engaged time on 9/21? 

On September 22, Jim's math class was only 50 minutes long 
but the average engagement rate was 90%. What was the 

student engaged time on 9/22? 

•«7W 9f (9 m $u-iui is ($ m uzm if (£ %08 *Z89 *%Q8 *%ZG (Z *l * v *' 7 (I 
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to 



En gagement mte 



JtojtnJ^ number of ^stud g o t ^s jgjigagcd^ 
total number of students assigned 



jj^HjjjIff j: Qngn^cd t itne = un^gtMiicnt rnte * nlln^ntcd time* 




1, Jerome Kenyatta's fifth grade math class was observed by Tad Tallchlef on September 21- The large group 
math class started at 10:35 and ended at 11:40. The data for the number of students engaged and unengaged 
is presented below. Find each aspect of time indicated below* 





10:36 


10:37 


10:38 


10t39 


10:40, 




10:^2, 




10; 44 


1°t45 


10:46 


10:47 


10:48 


10:49 


10:50 


TOTAL 


# students 
unengaged 


17 


10 


5 


0 


2 


3 


1 


4 


5 


8 


2 


1 


0 


2 


2 


62 


/ ! students 
ot -gaged 


13 , 


20 


25 


30 


28 


27 


29 


26 


25 


22 


28 


29 


30 


28 


28 


388 


■ students 
assigned ' 


30 


30 


30 


30 


30 


30 


30 


30 


30 


30 


30 


30 


30 


30 


30 


450 



a) Engagement Rate 



b) Allocated Time = 



c) Student Hn^a^ed Time 



2. Ann Riley's sixth grade language arts class was observed by Peter Demetrios on October 3. 

Peter observed a language arts class that started at lsl5 and ended at 2:15. The data for the number 
of students engaged and unengaged during the time Peter observed are recorded below. Find each aspect 
of time indicated below. 



TIME 


1:16 


1:17 


1:18 


1:19 1 


1:20 


1:21 


1:22 


1:23 


1:24 


1:25 


1 :26 


1 : 27 


1:28 


1:29 
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TOTAL 


# students 
unengaged 


25 


5 


1 


0 


0 


0 


10 


4 


3 


2 


2 


1 


0 


1 


2 


56 


* students 
engaged 


0 


20 


24 


25 


25 


25 


15 


. 21 


22 


23 


23 


24 


25 


24 


23 


319 


# students 
assisned 


25 


25 


25 


25 


25 


25 


25 


25 


25 


25 


25 


25 


25 


25 


25 


375 




a) Engagement Rate _ b) Allocated Time = 

•U7W /$ {D UfTM 09 (q %SS 



c) Student KnRagod Time 
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RESEARCH FINDINGS ON TIME 

Allocated Time 

Data from four separate studies Indicate that, in general, 
teachers allocate between 96 and 133 minutes each day for reading/ 
language arts and 37 to 53 minutes for math (see Table 1). 

Table 1 

Average Time Allocations in Minutes for Reading/ 
Language Arts and Mathematics 





Mann 
Study 
(1928) 


Beginning Teacher 
Evaluation Study 
Phase II (1976) 


Instructional 
Dimensions 
Study (1977) 


Beginning Teacher 
Evaluation Study 
Phase III (1977) 




Grade 3 


Grade 2 


Grade 5 


Grade 1 


Grade 3 


Grade 2 


Grade 5 


Reading 


70.4 


63.6 


54.9 


105.8 


84.5 


86 


112 


Language 
Arts 


62.8 










Math 


39.2 


37.5 


48.0 


48.6 


52.6 


37 


42 



Although stare regulations and funding programs have to some extent standardized 
the length of the school year and the school day, teachers can exercise some 
control over how much of that time is allocated to a particular subject. 
Studies have, in fact, shown that there is extreme variation among teacher 
allocations. 7or example, Dishaw (1977) reports that time allocated for second 
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grade math ranged from a low of 30 minutes to a high of 59 minutes and for 
second grade reading from 34 minutes to 127 minutes. Time allocated for 
fifth grade math ranged from 23 minutes to 76 minutes; time allocated for 
fifth grade reading ranged from 57 to 156 minutes. These differences In 
allocated time suggest that some students may have two or three times as 
much opportunity to learn specific academic content as other students. 
Common sense suggests that the greater the student's opportunity to learn, 
the greater likelihood he/she will learn. Thus, through the relatively 
simple act of allocating time in reading/language arts and mathematics » 
teachers can affect student achievement. 

Three separate studies that indicate that allocated time is positively 
related to student achievement are the Beginning Teacher Evaluation Study 
Phase lit Phase III of the same series of studies* and the Instructional 
Dimensions Study. The Beginning Teacher Evaluation Study (McDonald & Ellas* 
1976; Fisher et al. > 1977) is a four-year series of studies begun in 1972 to 
provide a research base to guide decision making for the California Commission 
for Teacher Preparation and Licensing. One study (BTES-Il) was conducted by 
the Educational Testing Service of Princeton, New Jersey* and the other study 
(BTES-IIl) by the Far West Laboratory of San Francisco. The third study, 
the Instructional Dimensions Srudy (IDS)> was conducted by Hugh Poynor and 
his associates (Brady et al. > 1977). This last study tested the instructional 
model developed at the Learning Research and Development Center at the 
University of Pittsburgh, using a sample of Title I eligible schools from 
five states, mostly in the Northeast. 



1.246 



27 n 



7/24/80 



In the BTES-II study, the relationship between student achievement 
and allocated time was always reported along- with the type of setting 
in which Instruction was received. The setting included the size of the 
group (individual, group, whole class) as well as the type of supervision 
(teacher, aide, student or students working independently). Any summary 
of the study T s findings on the relationship of allocated time and student 
achievement is made even more difficult, since the findings varied by 
grade level and subject. One consistent finding for fifth grade math was 
that time allocated to total class instruction (by the teacher) in math 
was related positively to achievement in math. 

The results of the BTES-II study also showed, however, that time 
allocated to some settings is related negatively to achievement. For 
example, time allocated to second graders working in reading groups 
without a teacher was related negatively to reading achievement; time 
allocated to second graders working on math in groups with an aide was 
also related negatively to achievement in math. 

The BTES-III study showed that allocated time related in varying 
degrees to student achievement. For example, in second grade reading, 
allocated time related positively with subtests for total comprehension 
and word structure, but did not relate to total reading score. In 
fifth grade reading, allocated time did not relate either positively or 
negatively to total comprehension* In both sacond and fifth grade math* 
allocated time was related positively to a subtest on fractions, but was 
related positively to total math achievement only in the fifth grade. 
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In the Instructional Dimensions Study (IDS), the relationship 
between student achievement and allocated time was always reported In 
conjunction with currlcular overlap (the extent to which what was taught 
was similar to what was measured on the criterion test). After pretest 
scores were taken Into consideration, the variable Including time and 
currlcular overlap accounted for the majority of the variability In 
the posttest scores. In other words, the study found that, of those 
variables examined* the second most Influential variable (after previous 
learning) Is a combination of allocated time and currlcular overlap. 

Engagement Rate 

Two of the three studies mentioned above also gathered data on 
engagement rate. The IDS indicated that the average engagement rate for 
reading and math was about 60 percent when data on student Involvement 
were compared with data from teacher logs. In the BTES-III study, the 
rate for reading and math was about 75 percent when student Involvement 
data were compared with teacher allocated time data gathered through 
systematic observation* The differences In the two rates are probably 
due to the fact that general management activities, transition time, and 
M down time" (when no activities were assigned to students) were not 
included in the BTES-III data, but were included In the IDS; that Is, 
absolute allocated time was used In BTES-III data, but intended allocated 
time was used in the IDS study* 
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S tudent e n gaged Time 

It was stated previously that In the BTES-III study, allocated time 
was related only sporadically to total achievement. Engaged time, however, 
was related positively to total reading achievement In second and fifth 
grades and to total math achievement in fifth grade. Another research 
study relating engaged time to student achievement was completed by 
Jane Stallings and David Kaskowitz. This 1972 study involved classrooms 
throughout the country that were using sponsored Follow Through program 
models. A reanalysis of the data (Rim and Coller, 1978) showed that, in 
general, the more engaged time spent in reading or math, the more students 
showed achievement in that subject. However, in the case of certain 
aspects of reading and math, gains in student achievement did not always 
increase as engaged time increased. Expected gains in achievement some- 
times leveled off and then decreased when engaged time was increased 
beyond a certain point. In other instances, expected gain in achievement 
leveled off and then rapidly increased again. 
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APPENDIX D 



SUPPLEMENTARY ACTIVITY FOR TOPIC D~ 
ENGAGEMENT RATE FORM 



One activity involving identifying engaged and unengaged behaviors 
is described here. You may wish to include this activity in your 
presentation of Topic D after viewing the videotape on unengaged behaviors 
(D.4) and before completing the coding of the classroom pictures (D.5). 
This activity may also be used in conjunction with the definitions on 
1H22 as a part of orientation. 

The following materials are included in this appendix: 

DH27 — Chart of Engaged and Unengaged Behaviors 

DT28-r-Answer Key for Chart 



Participants will also need the following handout from Topic D: 

1H22 — Definitions of Categories for Engagement Rate Form 

In using these materials* have participants independently identify the 
engaged and unengaged behaviors on the chart using the definitions on 
1H22 and then check and discuss answers* 
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CHART OF ENGAGED AND UNENGAGED BEHAVIORS 



1)1127 



tf the student is engaged, write E in the Engaged Column, If the .student is un- 
en-a^ed, write one of t\w following let tors tf) doscr f he how the student is un- 
engaged in the last column* 

H = Management/Transition 

S = Socializing 

D - Discipline 

U - Unoccupied/Observing 

Students Assigned to Reading/Language Arts 



Situation 


Engaged 


Unengaged 


Student is reading aloud during a reading group. 






Student is giving an answer to the teacher's question 
about tha story she read. 






Student is coloring a picture to go with a story he 
juct read. 






Student is waiting at desk with hand raised to have 
reading workbook checked . 






Student is talking with another student about lunch. 







Students Assigned to Mathematics 



Student is looking at teacher during presentation of 
math content. 






Student is getting number rods from the cabinet. 






Student has her head and math textbook in appropriate 
relative position for reading problems. 






Student is calling out answers when presented with 
math flash cards. 






Student is listening to teacher reprimand another 
student for not doing his homework. 






Student is building a tower of 20 Cuisenaire rods 
while assigned to solve 5+3, 2+6, and 1-1-7 with rods. 
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CHART OF ENGAGED AND UNENGAGED BEHAVIORS 

If the student is engaged, write E in the Engaged Column. If the student i« nn- 
engaged, write one of the following letters to describe how the student i« un- 
engaged in the las t column. 

K - Management/Transition 

S = Socializing 

D = Discipline 

U = Unoccupied/Observing 

Students Assigned to Reading /Language Arts 



Situation 


Engaged 


Unengaged 


Student is reading aloud during a reading group < 


£ 




Student is giving an answer to the teacher's question 
about ths story she read. 


£ 




Student is coloring a picture to go with a story he 
just rcjad. 


£ 




Student is waiting at desk with hand raised to have 
reading workbook checked. 




M 


Student is talking with anccher student about lunch. 




5 





Students Assigned to Mathematics 



Student is looking at teacher during presentation of 
math content. 


£ 




Student is getting number rods from the cabinet. 






Student has her head and math textbook in appropriate 
relative position for reading problems. 


£ 




Student is calling out answers when presented with 
m£th flash cards. 


£ 




Student is listening to teacher reprimand another 
student for not doing his homework. 




D 


Student is building a tower of 20 Cuisenaire rods 
while assigned to solve 5+3, 2+6, and 1+7 with rods. 




LL 
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APPENDIX B 



SUPPLEMENTARY ACTIVITIES FOR TOPIC E 
OBSERVER TRAINING ON THE ENGAGEMENT RATE foRM 

This appendix contains the materials and notes for six supplementary five- 
observation videotape segments (Supplementary Tape for Appendix E) . Leaders 
may wish to use one or more of these segments as review or extra practice in 
appropriate situations. A description of each segment follows; the segments 
are sequenced according to their difficulty, with the easier ones first. 

Middle of first grade reading; teacher-directed whole class 
lesson on single and double consonants and naming and 
describing words 

Continuation of EV32d 

Middle of fourth-grade reading; teacher-directed correction 
of workbooks with whole class 

Middle of first grade math; seatwork (continuation of lV32c) 

Middle of sixth grade math; teacher^directed whole-class 
review of homework and recording of scores followed by new 
assignment and seatwork 

Continuation of EV32h 



EV32d 

EV32e 
EV32f 

EV32g 
EV32h 




EV32i 



If supplementary tapes are needed or desired. Research for Better Schools 
will provide regional agencies with a tape # handouts, transparencies # 
and notes in return for a blank 1-hour tape. 
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